-- Logs begin at Thu 2022-08-18 19:55:14 UTC, end at Thu 2022-08-18 21:28:07 UTC. -- Aug 18 20:59:53.570812 dv-osbrick-849018-5-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 18 20:59:53.581978 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 18 20:59:53.584070 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 20:59:53 2022] *** Aug 18 20:59:53.584070 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 20:59:53.584070 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 20:59:53.584070 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: nodename: dv-osbrick-849018-5-ceph Aug 18 20:59:53.584070 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: machine: x86_64 Aug 18 20:59:53.584070 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: clock source: unix Aug 18 20:59:53.584070 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: pcre jit disabled Aug 18 20:59:53.584070 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: detected number of CPU cores: 4 Aug 18 20:59:53.584070 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: current working directory: / Aug 18 20:59:53.584070 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: detected binary path: /usr/bin/uwsgi-core Aug 18 20:59:53.584070 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: your processes number limit is 47680 Aug 18 20:59:53.584825 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: your memory page size is 4096 bytes Aug 18 20:59:53.584825 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: detected max file descriptor number: 2048 Aug 18 20:59:53.584825 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: lock engine: pthread robust mutexes Aug 18 20:59:53.584825 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: thunder lock: enabled Aug 18 20:59:53.584825 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 18 20:59:53.584825 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 20:59:53.630072 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: Python main interpreter initialized at 0x55786be229c0 Aug 18 20:59:53.630072 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: python threads support enabled Aug 18 20:59:53.630072 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: your server socket listen backlog is limited to 100 connections Aug 18 20:59:53.630072 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: your mercy for graceful operations on workers is 90 seconds Aug 18 20:59:53.630387 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 20:59:53.630493 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: *** Operational MODE: preforking *** Aug 18 20:59:53.630760 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: *** uWSGI is running in multiple interpreter mode *** Aug 18 20:59:53.630760 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: spawned uWSGI master process (pid: 88570) Aug 18 20:59:53.630958 dv-osbrick-849018-5-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 18 20:59:53.631564 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: spawned uWSGI worker 1 (pid: 88581, cores: 1) Aug 18 20:59:53.631906 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: spawned uWSGI worker 2 (pid: 88582, cores: 1) Aug 18 20:59:53.632390 dv-osbrick-849018-5-ceph devstack@keystone.service[88570]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 20:59:58.236982 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:59:58.236982 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: from cryptography.utils import int_from_bytes Aug 18 20:59:58.237795 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:59:58.237795 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: from cryptography.utils import int_from_bytes Aug 18 20:59:58.238402 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:59:58.238402 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: from cryptography.utils import int_from_bytes Aug 18 20:59:58.238848 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:59:58.238848 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: from cryptography.utils import int_from_bytes Aug 18 20:59:58.287391 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:59:58.287562 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:59:58.287758 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] command line args: [] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:59:58.288037 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:59:58.288213 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ================================================================================ {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:59:58.288463 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] admin_token = **** {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.288709 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] config_dir = [] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.288898 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.288974 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:59:58.289079 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] config_source = [] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.289157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:59:58.289258 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] debug = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.289341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] command line args: [] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:59:58.289460 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.289712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:59:58.289712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ================================================================================ {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:59:58.289831 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.289973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] admin_token = **** {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.290059 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.290221 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] config_dir = [] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.290327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.290421 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.290528 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.290623 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] config_source = [] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.290728 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] list_limit = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.290822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] debug = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.290921 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] log_config_append = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.291033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.291162 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.291299 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.291413 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] log_dir = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.291413 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] log_file = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.291597 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.291704 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.291799 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.291882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.291997 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.292077 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.292196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] list_limit = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.292196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] log_config_append = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.292381 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.292464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.292583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.292660 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] log_dir = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.292778 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.292901 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] log_file = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.292985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.293106 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.293180 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.293300 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.293384 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.293461 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.293574 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.293707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.293788 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.293869 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.293991 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.294065 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.294179 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.294286 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.294400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.294559 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.294685 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.294794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.295027 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.295158 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.295284 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.295381 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] publish_errors = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.295524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.295605 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.295770 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.295852 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.295959 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.296039 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.296204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.296285 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.296437 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.296670 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] standard_threads = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.296751 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.296900 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.296981 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] publish_errors = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.297142 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.297229 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.297320 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.297396 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.297497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] use_journal = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.297582 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.297658 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] use_json = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.297773 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.297849 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] use_stderr = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.297993 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] use_syslog = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.298075 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.298222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.298306 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] standard_threads = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.298452 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.298532 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.298697 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.298774 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.298876 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.298953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.299054 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] use_journal = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.299182 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.299274 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] use_json = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.299418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] use_stderr = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.299508 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.299580 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] use_syslog = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.299689 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.299815 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:59:58.299940 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.300070 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.300177 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.300308 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.300425 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.300568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.300673 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.300806 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.301039 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.301174 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.301306 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.301434 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.301563 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.301685 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.301824 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.301949 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.302073 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.302196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.302315 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.302451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.302588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.302714 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.302836 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.302959 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.303082 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.303211 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.303369 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.303504 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.303629 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.303751 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.303874 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.304002 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.304202 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.304332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.304454 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.304576 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.304699 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.304829 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.304952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.305076 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.305214 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.305344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.305465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.305596 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.305719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.305840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.305966 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.306090 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.306162 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.306330 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.306454 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.306577 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.306699 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.306822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.306954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.307084 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.307205 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.307356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.307475 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.307597 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.307720 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.307853 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.307976 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.308099 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.308227 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.308356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.308479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.308621 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.308748 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.308869 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.308991 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.309113 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.309274 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.309408 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.309530 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.309652 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.309781 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.309903 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.310048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.310048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.310872 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.311021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.311145 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.311311 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.311432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.311569 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.311693 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.311817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.311937 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.312060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.312188 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.312318 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.312440 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.312583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.312706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.312788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.312858 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.312939 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.313016 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.313086 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.313154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.313222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.313290 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.313365 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.313436 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.313510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.313615 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.313694 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.313832 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.313912 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314101 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314183 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314259 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314334 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314413 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314484 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314554 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314623 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314693 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314844 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314927 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.314927 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.315055 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.315124 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.315204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.315204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.315362 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.315362 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.315491 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.315586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.315664 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.315820 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.315903 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.316056 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.316137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.316302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.316377 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.316540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.316626 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.316775 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.316852 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.317018 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.317094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.317254 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.317337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.317489 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.317626 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.317758 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.317884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.318015 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.318148 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.318271 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.318399 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.318399 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.318633 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.318633 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.318876 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.319002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.319125 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.319253 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.319420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.319545 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.319678 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.319802 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.319927 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.320051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.320182 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.320306 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.320438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.320562 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.320685 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.320685 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.320925 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.321060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.321268 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.321392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.321519 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.321643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.321767 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.321902 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.322034 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.322168 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.322298 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.322422 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.322546 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.322675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.322797 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.322938 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.323064 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.323192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.323376 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.323498 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] auth.external = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.323621 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.323756 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.323879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.323879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.324114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.324240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.324364 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.324498 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.324622 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] auth.password = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.324622 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] auth.token = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.324871 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.324991 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.325126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.325288 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.325426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.325559 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.325742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.326407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.326534 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] auth.external = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.326656 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.326775 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.326911 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.327054 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.327182 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.327323 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.327443 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] credential.caching = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.327568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] auth.password = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.327704 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.327830 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] auth.token = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.327955 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.328080 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.328205 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.328331 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.328464 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.328588 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.328710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.328865 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.328995 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.329122 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.329255 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.329382 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.329506 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.329631 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.329755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.329880 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] credential.caching = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.330013 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.330137 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.330516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.330642 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.330777 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.330900 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.331033 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.331158 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.331305 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.331428 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.331553 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.331678 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.331813 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] federation.caching = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.331936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.332058 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.332190 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.332315 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.332440 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.332582 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.332708 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.332833 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.332958 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.333082 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.333212 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.333345 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.333471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.333596 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.333721 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.333846 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.333981 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.334107 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.334240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] federation.caching = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.334366 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.334490 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.334616 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.334748 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.334874 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.caching = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.334997 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.335121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.335246 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.335387 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.335477 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.335552 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.335623 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.335693 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.335763 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.335834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.335912 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.335984 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.336055 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.336125 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.336195 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.336264 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.336405 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.336480 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.336558 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.caching = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.336631 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.336701 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.336770 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.336852 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.336925 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.336995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.337065 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.337136 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.337206 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.337284 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.337357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.337428 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.337498 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.337569 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.337639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.337717 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.337789 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.337860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.337990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.338070 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.338141 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.338220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.338293 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.338363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.338434 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.338605 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.338683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.338853 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.338933 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.339096 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.339173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.339363 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.339446 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.339611 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.339691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.339839 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.339915 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.340084 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.340163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.340329 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.340408 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.340558 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.340634 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.340796 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.340874 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.341028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.341143 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.341258 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.341359 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.341521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.341599 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.341763 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.341842 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.342011 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.342089 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.342244 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.342330 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.342484 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.342561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.342724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.342802 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.342960 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.343045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.343207 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.343299 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.343480 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.343557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.343709 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.343801 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.343942 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.344021 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.344171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.344248 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.344409 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.344495 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.344643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.344719 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.344878 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.344956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.345112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.345199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.345343 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.345420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.345581 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.345659 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.345829 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.345914 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.346058 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.346134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.346287 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.346364 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.346535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.346619 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.346780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.346858 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.347015 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.347092 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.347240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.347398 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.347498 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.347576 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.347727 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.347804 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.347960 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.348044 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.348192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.348270 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.348434 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.348511 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.348676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.348760 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.348921 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.349003 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.349162 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.349239 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.349396 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.349480 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.349628 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.349706 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.349865 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.349944 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.350098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.350182 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.350331 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.350408 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.350562 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.350638 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.350795 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.350881 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.351038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.351115 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.351297 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.351377 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.351534 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.351622 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.351780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.351857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.352007 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.352083 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.352252 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.352341 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.352485 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.352561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.352719 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.352796 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.352953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.353038 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.353187 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.353263 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.353431 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.353507 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.353663 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.353749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.353900 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.353978 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.354140 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] resource.caching = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.354218 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.354370 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.354455 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.354616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.354694 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.354850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.354926 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.355091 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.355175 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.355360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.355438 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.355600 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.355678 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.355840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.355928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.356073 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.356149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.356311 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.356399 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.356547 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] role.caching = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.356635 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] resource.caching = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.356795 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] role.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.356876 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.357075 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.357153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.357324 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.357410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.357595 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.357683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.357814 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.357892 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.358060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.358140 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.358302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.358378 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.358539 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.358615 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.358781 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.358866 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.359020 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] role.caching = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.359098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.359294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.359374 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] role.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.359511 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.359589 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.359755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.359832 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.360001 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.360112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.360242 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.360320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.360487 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.360633 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.360736 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.360871 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.360983 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.361121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.361231 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.361369 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.361479 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.361615 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.361701 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.361863 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.361941 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.362096 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.362174 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.362349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.362440 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.362598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.362676 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.362836 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.363028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.363106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.363288 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.363371 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.363528 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.363605 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.363779 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.363868 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.364028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.364104 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.364272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.364348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.364508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.364592 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.364741 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.364818 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.364973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.365051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.365207 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] token.caching = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.365293 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.365445 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.365523 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.365676 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.365753 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.365909 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.365994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.366159 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.366237 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.366403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.366479 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.366640 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.366725 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.366874 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.366950 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.367111 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.367189 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.367376 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.367468 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.367610 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.367687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] token.caching = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.367845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.367921 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.368085 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.368170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.368321 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.368397 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.368569 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.368645 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.368800 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.368886 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.369036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.369112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.369280 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.369357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.369523 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.369613 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.connection = **** {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.369773 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.369859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.370010 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.370087 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.370249 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.370327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.370486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.370564 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.370721 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.370798 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.370956 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.371033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.371184 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.371289 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.371442 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.371520 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.371684 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.371811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.371919 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.372077 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.connection = **** {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.372163 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.372322 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.372452 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.373139 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.373266 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.373394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.373533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.373657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.373782 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.373914 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.373990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.374062 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.374176 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.374280 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.374412 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.374517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.374595 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:59:58.374762 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.374999 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.375241 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.375498 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.375751 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.375988 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.376230 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.376461 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.376700 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.376935 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:59:58.377105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:59:58.403488 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.403715 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.403995 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.405714 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.405949 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.406186 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.412734 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.414908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.441600 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.441832 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.441991 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.442222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.493625 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.494598 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.542628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.542861 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.544417 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.545170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.609630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.610136 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.610136 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.610405 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.610470 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.610534 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.610594 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.610676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.610806 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.611053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.611286 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.611582 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.634293 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.634527 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.634755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.634888 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.635018 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.635170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.635395 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.635536 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.635536 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.635795 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.635924 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.636060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.636189 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.636189 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.647281 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.647647 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.659862 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.660096 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.660255 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.660456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.660591 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.660768 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.660892 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.661015 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.661138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.661260 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.661382 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.661513 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.661636 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.661636 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:59:58.678358 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.678567 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:59:58.678806 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.678932 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.679061 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:59:58.679189 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:59:58.679372 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.679501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.679636 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:59:58.679763 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.679883 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.680005 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.680137 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.680269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.680391 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.680573 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.690124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.690403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.690680 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.690817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.690942 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.691068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.691239 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.691549 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.697851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.698490 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.700777 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.701060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.701345 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.701506 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.701634 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.701794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.701920 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.702082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.702217 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.702375 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.702502 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.702661 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.702785 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.702909 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.703041 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.703165 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.703318 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.703467 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.703601 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.703740 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.704006 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.704275 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.727446 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.727790 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.728909 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.729196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.729321 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.729517 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.734361 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.734571 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.734709 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.734861 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.735278 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.736534 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.741661 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.741932 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.742915 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.743203 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.745976 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.746229 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.746513 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.746914 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.747192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.747336 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.747529 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.748196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.748334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.748459 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.748590 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.748804 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.749084 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.749365 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.749637 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.749908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.764135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.764434 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.765622 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.765903 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.768304 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.769766 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.771428 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.771834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.772909 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.773315 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.776063 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.777531 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.779180 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.780807 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.782280 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.782589 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.782878 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.783296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.783585 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.783879 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.783960 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.784225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.784526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.784925 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.785220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.785648 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.800112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.800401 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.800670 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.800943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.802564 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.802853 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.803126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.803430 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.807662 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.809331 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.809610 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.810821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.812606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.812816 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.812903 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.813102 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.813394 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.813687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.813972 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.815563 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.815851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.816145 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.816431 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.816721 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.825114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.825399 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.825708 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.825993 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.826276 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.826554 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.826842 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.828359 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.828641 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.828926 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.829210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.829494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.829793 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.830073 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.842503 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.845560 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.845868 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.848571 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.848793 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.849996 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.851505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.851794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.851877 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.852079 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.853273 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.854746 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.855032 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.855361 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.859050 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.860564 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.862413 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.863430 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.863722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.863928 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.864011 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.864280 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.866814 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.867110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.867443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.867736 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.873659 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.873944 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.874222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.876342 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.876640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.876925 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.881110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.881492 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.881772 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.882062 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.882340 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.882624 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.882910 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.883182 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.883479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.883759 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.884041 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.884135 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:59:58.884312 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.884590 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.884853 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.885347 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.885637 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.885931 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.886223 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.886504 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.886788 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.887081 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.887476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.887754 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.888038 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.888332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.888608 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.888877 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:59:58.917902 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55786be229c0 pid: 88582 (default app) Aug 18 20:59:58.921815 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb2ee8-f7fc-40a7-b212-63306f053688 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:58.922105 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb2ee8-f7fc-40a7-b212-63306f053688 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:58.922379 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb2ee8-f7fc-40a7-b212-63306f053688 None None] PATH_INFO: `/v3` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:58.922477 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55786be229c0 pid: 88581 (default app) Aug 18 20:59:58.926528 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Thu Aug 18 20:59:58 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:05.932171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4fc95-c31e-4a98-acbe-08fe2a9ddc2b None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:05.932743 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4fc95-c31e-4a98-acbe-08fe2a9ddc2b None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:05.932743 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4fc95-c31e-4a98-acbe-08fe2a9ddc2b None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:05.937502 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:00:05.942554 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6da2f-11b7-4c79-b9d3-0633e4f34bb2 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:05.942932 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6da2f-11b7-4c79-b9d3-0633e4f34bb2 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:05.943140 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6da2f-11b7-4c79-b9d3-0633e4f34bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:06.020556 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: INFO dbcounter [None req-cff6da2f-11b7-4c79-b9d3-0633e4f34bb2 None None] Registered counter for database keystone Aug 18 21:00:06.039815 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG oslo_db.sqlalchemy.engines [None req-cff6da2f-11b7-4c79-b9d3-0633e4f34bb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:00:06.046599 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writer thread running {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:00:06.228124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG passlib.handlers.bcrypt [None req-cff6da2f-11b7-4c79-b9d3-0633e4f34bb2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88582) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 21:00:06.228453 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG passlib.handlers.bcrypt [None req-cff6da2f-11b7-4c79-b9d3-0633e4f34bb2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88582) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 21:00:06.283552 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-cff6da2f-11b7-4c79-b9d3-0633e4f34bb2 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:06.285384 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-cff6da2f-11b7-4c79-b9d3-0633e4f34bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:06.412423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 21:00:06.927472 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4fc95-c31e-4a98-acbe-08fe2a9ddc2b None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:07.002673 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: INFO dbcounter [None req-fdd4fc95-c31e-4a98-acbe-08fe2a9ddc2b None None] Registered counter for database keystone Aug 18 21:00:07.024577 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG oslo_db.sqlalchemy.engines [None req-fdd4fc95-c31e-4a98-acbe-08fe2a9ddc2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:00:07.031268 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writer thread running {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:00:07.148165 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4fc95-c31e-4a98-acbe-08fe2a9ddc2b None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:07.152375 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26312f74-847f-4c56-a225-a95a49a1854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:07.153577 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26312f74-847f-4c56-a225-a95a49a1854f admin admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:07.153864 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26312f74-847f-4c56-a225-a95a49a1854f admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:07.154131 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26312f74-847f-4c56-a225-a95a49a1854f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:07.162109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26312f74-847f-4c56-a225-a95a49a1854f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:07.214334 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: WARNING keystone.common.rbac_enforcer.enforcer [None req-26312f74-847f-4c56-a225-a95a49a1854f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 21:00:07.214618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26312f74-847f-4c56-a225-a95a49a1854f admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:07.223976 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Aug 18 21:00:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 21:00:07.229971 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6da2f-11b7-4c79-b9d3-0633e4f34bb2 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:07.247420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6da2f-11b7-4c79-b9d3-0633e4f34bb2 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:07.251834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d62a6f-fff0-4a53-9710-e23e54132fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:07.252927 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d62a6f-fff0-4a53-9710-e23e54132fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:07.253224 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d62a6f-fff0-4a53-9710-e23e54132fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:07.253482 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d62a6f-fff0-4a53-9710-e23e54132fb4 admin admin] PATH_INFO: `/v3/projects/9fde81811a6d48dea0f606eb2c250dc9` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:07.254905 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d62a6f-fff0-4a53-9710-e23e54132fb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fde81811a6d48dea0f606eb2c250dc9)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:07.305805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: WARNING keystone.common.rbac_enforcer.enforcer [None req-46d62a6f-fff0-4a53-9710-e23e54132fb4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 21:00:07.306148 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d62a6f-fff0-4a53-9710-e23e54132fb4 admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:07.310734 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Aug 18 21:00:07 2022] GET /identity/v3/projects/9fde81811a6d48dea0f606eb2c250dc9 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:09.422408 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00523247-860d-4903-8e43-8814995f6bc5 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:09.422944 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00523247-860d-4903-8e43-8814995f6bc5 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:09.422944 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00523247-860d-4903-8e43-8814995f6bc5 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:09.427039 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:00:09.432309 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe3a60-82a3-4218-8fd3-eb938cb0bd9c None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:09.432692 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe3a60-82a3-4218-8fd3-eb938cb0bd9c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:09.432862 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe3a60-82a3-4218-8fd3-eb938cb0bd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:09.452945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-7afe3a60-82a3-4218-8fd3-eb938cb0bd9c None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:09.454702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-7afe3a60-82a3-4218-8fd3-eb938cb0bd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:09.462377 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 21:00:09.792373 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00523247-860d-4903-8e43-8814995f6bc5 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:09.804511 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00523247-860d-4903-8e43-8814995f6bc5 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:09.808727 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97cc34-c103-4e5e-abe0-a3fa6b0a1487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:09.809820 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97cc34-c103-4e5e-abe0-a3fa6b0a1487 admin admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:09.810100 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97cc34-c103-4e5e-abe0-a3fa6b0a1487 admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:09.810370 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97cc34-c103-4e5e-abe0-a3fa6b0a1487 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:09.817894 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97cc34-c103-4e5e-abe0-a3fa6b0a1487 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:09.819697 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97cc34-c103-4e5e-abe0-a3fa6b0a1487 admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:09.828899 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Aug 18 21:00:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 21:00:09.834340 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe3a60-82a3-4218-8fd3-eb938cb0bd9c None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:09.843450 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe3a60-82a3-4218-8fd3-eb938cb0bd9c None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:09.847768 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9f07f-1651-4741-a4fb-b469b7d74f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:09.848416 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9f07f-1651-4741-a4fb-b469b7d74f66 admin admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:09.848701 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9f07f-1651-4741-a4fb-b469b7d74f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:09.848979 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9f07f-1651-4741-a4fb-b469b7d74f66 admin admin] PATH_INFO: `/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:09.850279 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9f07f-1651-4741-a4fb-b469b7d74f66 admin admin] RBAC: Authorizing `identity:get_user(user_id=71471eb8a3e6483ebb3f0a3b9d99aedd)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:09.852136 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9f07f-1651-4741-a4fb-b469b7d74f66 admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:09.853643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Aug 18 21:00:09 2022] GET /identity/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:12.078912 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb4005-7662-4ff7-9471-acc34c54f656 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:12.079728 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb4005-7662-4ff7-9471-acc34c54f656 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:12.079728 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb4005-7662-4ff7-9471-acc34c54f656 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:12.081061 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:12.086108 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359812d4-f92c-442a-99dd-b89c50f8d47f None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:12.086517 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359812d4-f92c-442a-99dd-b89c50f8d47f None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:12.086663 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359812d4-f92c-442a-99dd-b89c50f8d47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:12.092741 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29263947-4074-4700-851e-7342b6cd088d None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:12.093028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29263947-4074-4700-851e-7342b6cd088d None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:12.093309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29263947-4074-4700-851e-7342b6cd088d None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:12.094638 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:00:12.099777 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10236119-f3ce-4fe2-bab9-dc4d871b9746 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:12.100072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10236119-f3ce-4fe2-bab9-dc4d871b9746 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:12.100353 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10236119-f3ce-4fe2-bab9-dc4d871b9746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:12.105488 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-359812d4-f92c-442a-99dd-b89c50f8d47f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:12.107320 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-359812d4-f92c-442a-99dd-b89c50f8d47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:12.142845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG passlib.handlers.bcrypt [None req-10236119-f3ce-4fe2-bab9-dc4d871b9746 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88581) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 21:00:12.143285 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG passlib.handlers.bcrypt [None req-10236119-f3ce-4fe2-bab9-dc4d871b9746 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88581) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 21:00:12.189791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-10236119-f3ce-4fe2-bab9-dc4d871b9746 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:12.191481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-10236119-f3ce-4fe2-bab9-dc4d871b9746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:12.299084 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:12.309600 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:00:12.622796 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359812d4-f92c-442a-99dd-b89c50f8d47f None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:12.628336 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10236119-f3ce-4fe2-bab9-dc4d871b9746 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:12.646803 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:12.727288 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359812d4-f92c-442a-99dd-b89c50f8d47f None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:12.727543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:12.730360 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10236119-f3ce-4fe2-bab9-dc4d871b9746 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:12.763016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b2343-dcc3-45df-8504-157cf660b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:12.763675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b2343-dcc3-45df-8504-157cf660b158 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:12.763958 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b2343-dcc3-45df-8504-157cf660b158 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:12.764235 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b2343-dcc3-45df-8504-157cf660b158 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:12.768887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e87e2-8e96-4869-bc90-b623d3141566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:12.769746 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e87e2-8e96-4869-bc90-b623d3141566 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:12.770026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e87e2-8e96-4869-bc90-b623d3141566 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:12.770300 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e87e2-8e96-4869-bc90-b623d3141566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:12.775173 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b2343-dcc3-45df-8504-157cf660b158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-3b0b2343-dcc3-45df-8504-157cf660b158 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:12.783888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:12.784973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:12.786126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:12.786126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:12.786126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:12.786126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:12.786126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:12.786126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:12.786126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:12.786126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:12.786126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:12.786126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:12.786126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:12.786126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:12.786126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:00:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:12.790746 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b2343-dcc3-45df-8504-157cf660b158 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:12.839875 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e87e2-8e96-4869-bc90-b623d3141566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:12.841418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e87e2-8e96-4869-bc90-b623d3141566 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:12.870759 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:12.890127 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b2343-dcc3-45df-8504-157cf660b158 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:12.922678 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e4cc3-3f25-4d8a-8a93-30c295cdf6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:12.923294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e4cc3-3f25-4d8a-8a93-30c295cdf6db None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:12.923573 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e4cc3-3f25-4d8a-8a93-30c295cdf6db None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:12.923843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e4cc3-3f25-4d8a-8a93-30c295cdf6db None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:12.924495 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e4cc3-3f25-4d8a-8a93-30c295cdf6db None admin] RBAC: Adding query filter params (name=admin) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:12.924800 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e4cc3-3f25-4d8a-8a93-30c295cdf6db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:12.926185 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e4cc3-3f25-4d8a-8a93-30c295cdf6db None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:12.934577 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:12.938645 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:12.943193 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:12.944087 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e4cc3-3f25-4d8a-8a93-30c295cdf6db None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:12.945178 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e87e2-8e96-4869-bc90-b623d3141566 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:13.051573 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e87e2-8e96-4869-bc90-b623d3141566 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:13.052240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e4cc3-3f25-4d8a-8a93-30c295cdf6db None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:13.090583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52404e16-415f-453b-8eaa-6128166d14d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:13.091342 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da4299-b539-429e-b9a9-f31f8e94e8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:13.091789 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52404e16-415f-453b-8eaa-6128166d14d8 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:13.091789 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52404e16-415f-453b-8eaa-6128166d14d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:13.092178 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52404e16-415f-453b-8eaa-6128166d14d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:13.092271 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da4299-b539-429e-b9a9-f31f8e94e8fd None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:13.092528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da4299-b539-429e-b9a9-f31f8e94e8fd None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:13.092808 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da4299-b539-429e-b9a9-f31f8e94e8fd None admin] PATH_INFO: `/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:13.094454 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da4299-b539-429e-b9a9-f31f8e94e8fd None admin] RBAC: Authorizing `identity:get_user(user_id=71471eb8a3e6483ebb3f0a3b9d99aedd)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:13.096079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da4299-b539-429e-b9a9-f31f8e94e8fd None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:13.097643 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:12 2022] GET /identity/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:13.102524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52404e16-415f-453b-8eaa-6128166d14d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:13.103178 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da4299-b539-429e-b9a9-f31f8e94e8fd None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:13.104157 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52404e16-415f-453b-8eaa-6128166d14d8 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:13.107358 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-52404e16-415f-453b-8eaa-6128166d14d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:00:13.122997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:13.123946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:00:13.124950 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:00:13.124950 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:00:13.124950 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:13.124950 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:13.129773 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52404e16-415f-453b-8eaa-6128166d14d8 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:13.178483 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:13.216960 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da4299-b539-429e-b9a9-f31f8e94e8fd None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:13.240477 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52404e16-415f-453b-8eaa-6128166d14d8 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:13.254920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d94560-5ba9-406a-86ab-8622f32f6c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:13.255588 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d94560-5ba9-406a-86ab-8622f32f6c3a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:13.255876 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d94560-5ba9-406a-86ab-8622f32f6c3a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:13.256153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d94560-5ba9-406a-86ab-8622f32f6c3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:13.257265 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d94560-5ba9-406a-86ab-8622f32f6c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:13.258734 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d94560-5ba9-406a-86ab-8622f32f6c3a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:13.260612 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:13.267533 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d94560-5ba9-406a-86ab-8622f32f6c3a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:13.277120 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406455d-9c1f-4927-befa-77d6c6adef83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:13.278271 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406455d-9c1f-4927-befa-77d6c6adef83 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:13.278550 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406455d-9c1f-4927-befa-77d6c6adef83 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:13.278817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406455d-9c1f-4927-befa-77d6c6adef83 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:13.279501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406455d-9c1f-4927-befa-77d6c6adef83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:13.279802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406455d-9c1f-4927-befa-77d6c6adef83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:13.281230 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406455d-9c1f-4927-befa-77d6c6adef83 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:13.301052 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:13.492284 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d94560-5ba9-406a-86ab-8622f32f6c3a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:13.528417 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57402f-7ea3-4023-ba4c-b699046337fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:13.529016 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57402f-7ea3-4023-ba4c-b699046337fb None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:13.529290 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57402f-7ea3-4023-ba4c-b699046337fb None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:13.529562 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57402f-7ea3-4023-ba4c-b699046337fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:13.530271 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57402f-7ea3-4023-ba4c-b699046337fb None admin] RBAC: Adding query filter params (role.id=49c7d15532d94cafac420a6bcf8574ad, scope.domain.id=default, user.id=71471eb8a3e6483ebb3f0a3b9d99aedd) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:13.530616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57402f-7ea3-4023-ba4c-b699046337fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:13.532044 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57402f-7ea3-4023-ba4c-b699046337fb None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:13.537373 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:13.541257 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Aug 18 21:00:13 2022] GET /identity/v3/role_assignments?user.id=71471eb8a3e6483ebb3f0a3b9d99aedd&scope.domain.id=default&role.id=49c7d15532d94cafac420a6bcf8574ad => generated 233 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:16.047055 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b49c1-7179-40fb-9402-2eee7c1718a8 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:16.048114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b49c1-7179-40fb-9402-2eee7c1718a8 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:16.048601 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b49c1-7179-40fb-9402-2eee7c1718a8 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:16.050135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:16.055625 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e9b15-3e6f-4957-8e79-30c5d33e0103 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:16.056043 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e9b15-3e6f-4957-8e79-30c5d33e0103 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:16.056174 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e9b15-3e6f-4957-8e79-30c5d33e0103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:16.066985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47829b-eaa9-437d-b4fe-94630acf4ccd None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:16.067665 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47829b-eaa9-437d-b4fe-94630acf4ccd None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:16.068143 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47829b-eaa9-437d-b4fe-94630acf4ccd None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:16.069724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 12/23] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:00:16.075727 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523c761-e167-4c68-b2ba-85ffeeb48a91 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:16.076295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523c761-e167-4c68-b2ba-85ffeeb48a91 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:16.076771 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523c761-e167-4c68-b2ba-85ffeeb48a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:16.080406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-554e9b15-3e6f-4957-8e79-30c5d33e0103 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:16.081583 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-554e9b15-3e6f-4957-8e79-30c5d33e0103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:16.102603 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-9523c761-e167-4c68-b2ba-85ffeeb48a91 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:16.104172 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-9523c761-e167-4c68-b2ba-85ffeeb48a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:16.200593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:16.237186 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 13/24] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:00:16.249496 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 12/25] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:16.290201 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e20934-864e-4716-ba35-a01b732c7189 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:16.290844 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e20934-864e-4716-ba35-a01b732c7189 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:16.291363 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e20934-864e-4716-ba35-a01b732c7189 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:16.292957 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 14/26] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:16.298381 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79fc7b-7107-47fa-9285-9843d81c7774 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:16.298602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79fc7b-7107-47fa-9285-9843d81c7774 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:16.298884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79fc7b-7107-47fa-9285-9843d81c7774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:16.325232 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-1d79fc7b-7107-47fa-9285-9843d81c7774 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:16.326428 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-1d79fc7b-7107-47fa-9285-9843d81c7774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:16.425572 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:16.633986 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a79de-3ea9-4074-bb5f-0777dca224de None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:16.634594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a79de-3ea9-4074-bb5f-0777dca224de None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:16.635071 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a79de-3ea9-4074-bb5f-0777dca224de None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:16.637218 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 15/28] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:16.656759 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70755c-b833-450e-aa33-82f0a8ca9a69 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:16.657054 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70755c-b833-450e-aa33-82f0a8ca9a69 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:16.657338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70755c-b833-450e-aa33-82f0a8ca9a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:16.680776 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-1f70755c-b833-450e-aa33-82f0a8ca9a69 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:16.681959 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-1f70755c-b833-450e-aa33-82f0a8ca9a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:16.702847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a79de-3ea9-4074-bb5f-0777dca224de None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:16.771831 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:16.798198 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 14/29] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:16.821743 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70755c-b833-450e-aa33-82f0a8ca9a69 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:16.894699 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a79de-3ea9-4074-bb5f-0777dca224de None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:16.926126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70755c-b833-450e-aa33-82f0a8ca9a69 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:16.952620 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d1e76-7f62-40b5-9f77-311fae1ca062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:16.953262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d1e76-7f62-40b5-9f77-311fae1ca062 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:16.953545 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d1e76-7f62-40b5-9f77-311fae1ca062 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:16.954080 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d1e76-7f62-40b5-9f77-311fae1ca062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:16.968903 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdbdf2-8c82-440d-897e-9a4783b15386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:16.969820 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdbdf2-8c82-440d-897e-9a4783b15386 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:16.970267 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdbdf2-8c82-440d-897e-9a4783b15386 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:16.970674 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdbdf2-8c82-440d-897e-9a4783b15386 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:16.976569 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d1e76-7f62-40b5-9f77-311fae1ca062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:16.978283 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d1e76-7f62-40b5-9f77-311fae1ca062 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:16.987363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdbdf2-8c82-440d-897e-9a4783b15386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-62cdbdf2-8c82-440d-897e-9a4783b15386 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:16.997464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:16.998492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:16.999385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:16.999385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:16.999385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:16.999385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:16.999385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:16.999385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:16.999385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:16.999385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:16.999385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:16.999385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:16.999385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:16.999385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:17.001451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 15/30] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:00:17.007294 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdbdf2-8c82-440d-897e-9a4783b15386 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-3a0d1e76-7f62-40b5-9f77-311fae1ca062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:00:17.008621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:17.009446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:00:17.010366 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:00:17.010366 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:00:17.010366 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:17.010366 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 16/31] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:17.020249 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d1e76-7f62-40b5-9f77-311fae1ca062 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:17.071976 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:17.103688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:17.119102 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdbdf2-8c82-440d-897e-9a4783b15386 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:17.155772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded2743-6927-4cd8-87db-90fd1b5132bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:17.156652 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded2743-6927-4cd8-87db-90fd1b5132bc None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:17.157127 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded2743-6927-4cd8-87db-90fd1b5132bc None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:17.157574 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded2743-6927-4cd8-87db-90fd1b5132bc None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:17.158410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded2743-6927-4cd8-87db-90fd1b5132bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:17.158887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded2743-6927-4cd8-87db-90fd1b5132bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:17.160472 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded2743-6927-4cd8-87db-90fd1b5132bc None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:17.173179 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 16/32] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:17.174237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded2743-6927-4cd8-87db-90fd1b5132bc None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:17.216323 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d1e76-7f62-40b5-9f77-311fae1ca062 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:17.262395 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d42e68-4e53-43e7-b82b-bbfc9a919eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:17.263051 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d42e68-4e53-43e7-b82b-bbfc9a919eaf None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:17.263363 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d42e68-4e53-43e7-b82b-bbfc9a919eaf None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:17.263641 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d42e68-4e53-43e7-b82b-bbfc9a919eaf None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:17.264295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d42e68-4e53-43e7-b82b-bbfc9a919eaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:17.264601 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d42e68-4e53-43e7-b82b-bbfc9a919eaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:17.266229 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d42e68-4e53-43e7-b82b-bbfc9a919eaf None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:17.279032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 17/33] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:17.279823 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d42e68-4e53-43e7-b82b-bbfc9a919eaf None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:17.285849 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded2743-6927-4cd8-87db-90fd1b5132bc None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:17.300404 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:17.323660 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9a0a6-3658-4a19-a240-ca98fc3e356d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:17.325130 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9a0a6-3658-4a19-a240-ca98fc3e356d None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:17.325595 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9a0a6-3658-4a19-a240-ca98fc3e356d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:17.326056 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9a0a6-3658-4a19-a240-ca98fc3e356d None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:17.326890 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9a0a6-3658-4a19-a240-ca98fc3e356d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:17.328478 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9a0a6-3658-4a19-a240-ca98fc3e356d None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:17.388811 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:17.392731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d42e68-4e53-43e7-b82b-bbfc9a919eaf None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:17.436017 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f13d6-f8d0-4bf7-808a-cb9d164a231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:17.436636 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f13d6-f8d0-4bf7-808a-cb9d164a231e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:17.436929 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f13d6-f8d0-4bf7-808a-cb9d164a231e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:17.437212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f13d6-f8d0-4bf7-808a-cb9d164a231e None admin] PATH_INFO: `/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:17.438383 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f13d6-f8d0-4bf7-808a-cb9d164a231e None admin] RBAC: Authorizing `identity:get_user(user_id=71471eb8a3e6483ebb3f0a3b9d99aedd)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:17.439879 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f13d6-f8d0-4bf7-808a-cb9d164a231e None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:17.445816 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 18/34] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:17 2022] GET /identity/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:17.445816 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f13d6-f8d0-4bf7-808a-cb9d164a231e None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:17.482435 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 17/35] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Aug 18 21:00:17 2022] POST /identity/v3/roles => generated 225 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:00:17.483815 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9a0a6-3658-4a19-a240-ca98fc3e356d None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:17.553469 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f13d6-f8d0-4bf7-808a-cb9d164a231e None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:17.599515 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9a0a6-3658-4a19-a240-ca98fc3e356d None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:17.604274 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e04644-3c36-4c59-ab67-659adca664eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:17.604578 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e04644-3c36-4c59-ab67-659adca664eb None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:17.604876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e04644-3c36-4c59-ab67-659adca664eb None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:17.605194 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e04644-3c36-4c59-ab67-659adca664eb None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:17.605882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e04644-3c36-4c59-ab67-659adca664eb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:17.615055 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e04644-3c36-4c59-ab67-659adca664eb None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:17.645966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c7ad9-331e-4575-943f-d0f44d1ce2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:17.647212 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c7ad9-331e-4575-943f-d0f44d1ce2fa None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:17.647789 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c7ad9-331e-4575-943f-d0f44d1ce2fa None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:17.648261 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c7ad9-331e-4575-943f-d0f44d1ce2fa None admin] PATH_INFO: `/v3/projects` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:17.649152 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c7ad9-331e-4575-943f-d0f44d1ce2fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:17.651164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c7ad9-331e-4575-943f-d0f44d1ce2fa None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:17.725990 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 18/36] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Aug 18 21:00:17 2022] POST /identity/v3/projects => generated 301 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:00:17.727236 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c7ad9-331e-4575-943f-d0f44d1ce2fa None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:17.765497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:17.825035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Aug 18 21:00:17 2022] POST /identity/v3/roles => generated 219 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:00:17.868513 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c7ad9-331e-4575-943f-d0f44d1ce2fa None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:17.889759 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8dc3e-b4d1-4dc6-ad46-96cb13f06f6d None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:17.890443 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8dc3e-b4d1-4dc6-ad46-96cb13f06f6d None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:17.890918 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8dc3e-b4d1-4dc6-ad46-96cb13f06f6d None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:17.893009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 20/38] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:17.898933 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a23add-dd07-4a57-b3bd-4e7640eaea9a None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:17.899630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a23add-dd07-4a57-b3bd-4e7640eaea9a None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:17.900103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a23add-dd07-4a57-b3bd-4e7640eaea9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:17.912441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b0640-72de-45b4-be9a-5f2758502457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:17.913155 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b0640-72de-45b4-be9a-5f2758502457 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:17.913444 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b0640-72de-45b4-be9a-5f2758502457 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:17.913719 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b0640-72de-45b4-be9a-5f2758502457 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:17.914953 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b0640-72de-45b4-be9a-5f2758502457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:17.916553 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b0640-72de-45b4-be9a-5f2758502457 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:17.919117 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 19/39] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:17.920571 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d926649-2f6b-4218-8836-5184834d32b9 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:17.920867 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d926649-2f6b-4218-8836-5184834d32b9 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:17.921144 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d926649-2f6b-4218-8836-5184834d32b9 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:17.922807 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 20/40] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:17.928428 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d926649-2f6b-4218-8836-5184834d32b9 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:17.930390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-e2a23add-dd07-4a57-b3bd-4e7640eaea9a None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:17.932027 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-e2a23add-dd07-4a57-b3bd-4e7640eaea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:17.966326 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:18.026080 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 21/41] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:18.027819 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531c5c-13de-407e-9f68-0e571a62ae96 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:18.028256 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531c5c-13de-407e-9f68-0e571a62ae96 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:18.028693 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531c5c-13de-407e-9f68-0e571a62ae96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:18.048953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-26531c5c-13de-407e-9f68-0e571a62ae96 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:18.051251 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-26531c5c-13de-407e-9f68-0e571a62ae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:18.058984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:18.077090 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d926649-2f6b-4218-8836-5184834d32b9 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:18.128930 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68f75-959b-4ffa-b5d5-7d00b2dfd1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:18.129752 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68f75-959b-4ffa-b5d5-7d00b2dfd1e4 None admin] REQUEST_METHOD: `PUT` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:18.130056 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68f75-959b-4ffa-b5d5-7d00b2dfd1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:18.130348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68f75-959b-4ffa-b5d5-7d00b2dfd1e4 None admin] PATH_INFO: `/v3/domains/default/users/71471eb8a3e6483ebb3f0a3b9d99aedd/roles/49c7d15532d94cafac420a6bcf8574ad` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:18.133127 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d68f75-959b-4ffa-b5d5-7d00b2dfd1e4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=71471eb8a3e6483ebb3f0a3b9d99aedd, role_id=49c7d15532d94cafac420a6bcf8574ad)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:18.135075 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d68f75-959b-4ffa-b5d5-7d00b2dfd1e4 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:18.142820 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:18.158222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1361 bytes} [Thu Aug 18 21:00:17 2022] PUT /identity/v3/domains/default/users/71471eb8a3e6483ebb3f0a3b9d99aedd/roles/49c7d15532d94cafac420a6bcf8574ad => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:00:18.380283 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26531c5c-13de-407e-9f68-0e571a62ae96 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:18.469047 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:18.475338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68f75-959b-4ffa-b5d5-7d00b2dfd1e4 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:18.489770 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26531c5c-13de-407e-9f68-0e571a62ae96 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:18.532583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6855a-96a0-4b56-b05b-de42622825a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:18.533480 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6855a-96a0-4b56-b05b-de42622825a2 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:18.533771 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6855a-96a0-4b56-b05b-de42622825a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:18.534048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6855a-96a0-4b56-b05b-de42622825a2 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:18.534887 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6855a-96a0-4b56-b05b-de42622825a2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:18.537153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6855a-96a0-4b56-b05b-de42622825a2 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:18.567287 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Aug 18 21:00:18 2022] POST /identity/v3/roles => generated 223 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:00:18.591330 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68f75-959b-4ffa-b5d5-7d00b2dfd1e4 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:18.628024 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e49076-e645-4646-b2e6-d05a6deb9646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:18.628686 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e49076-e645-4646-b2e6-d05a6deb9646 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:18.628972 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e49076-e645-4646-b2e6-d05a6deb9646 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:18.629247 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e49076-e645-4646-b2e6-d05a6deb9646 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:18.630563 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e49076-e645-4646-b2e6-d05a6deb9646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:18.632034 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e49076-e645-4646-b2e6-d05a6deb9646 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:18.633909 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 22/45] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:18.640106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6855a-96a0-4b56-b05b-de42622825a2 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:18.757450 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6855a-96a0-4b56-b05b-de42622825a2 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:18.793651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c6ea5-ddee-438d-a7a3-65cbc5bdb017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:18.794478 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c6ea5-ddee-438d-a7a3-65cbc5bdb017 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:18.794895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c6ea5-ddee-438d-a7a3-65cbc5bdb017 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:18.795333 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c6ea5-ddee-438d-a7a3-65cbc5bdb017 None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:18.796113 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c6ea5-ddee-438d-a7a3-65cbc5bdb017 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:18.797775 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c6ea5-ddee-438d-a7a3-65cbc5bdb017 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:18.820759 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:18.828344 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Aug 18 21:00:18 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:00:20.326464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cd694-d6ca-4d41-8ba4-faaee01473da None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:20.326975 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cd694-d6ca-4d41-8ba4-faaee01473da None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:20.327085 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cd694-d6ca-4d41-8ba4-faaee01473da None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:20.328629 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:20.333809 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e85491-b275-41c9-b207-1f7f86da2329 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:20.334207 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e85491-b275-41c9-b207-1f7f86da2329 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:20.334432 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e85491-b275-41c9-b207-1f7f86da2329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:20.352440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-e7e85491-b275-41c9-b207-1f7f86da2329 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:20.353615 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-e7e85491-b275-41c9-b207-1f7f86da2329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:20.418400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:00:20.742055 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cd694-d6ca-4d41-8ba4-faaee01473da None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:20.764557 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:20.845479 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cd694-d6ca-4d41-8ba4-faaee01473da None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:20.881584 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02566c1-a54e-4a90-a7d1-5da7f03f4de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:20.882120 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02566c1-a54e-4a90-a7d1-5da7f03f4de7 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:20.882404 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02566c1-a54e-4a90-a7d1-5da7f03f4de7 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:20.882681 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02566c1-a54e-4a90-a7d1-5da7f03f4de7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:20.894073 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02566c1-a54e-4a90-a7d1-5da7f03f4de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-f02566c1-a54e-4a90-a7d1-5da7f03f4de7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:20.898772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:20.899768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:20.900524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:20.900524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:20.900524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:20.900524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:20.900524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:20.900524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:20.900524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:20.900524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:20.900524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:20.900524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:20.900524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:20.900524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:20.900524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:00:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:20.906309 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e85491-b275-41c9-b207-1f7f86da2329 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:21.002494 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e85491-b275-41c9-b207-1f7f86da2329 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:21.005379 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1a622-fef4-4406-9fc7-beeef53f7100 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:21.005674 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1a622-fef4-4406-9fc7-beeef53f7100 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:21.005950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1a622-fef4-4406-9fc7-beeef53f7100 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:21.007314 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 25/50] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:00:21.012275 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61dada-e0ad-48b3-80f8-5af88b544357 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:21.012562 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61dada-e0ad-48b3-80f8-5af88b544357 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:21.012839 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61dada-e0ad-48b3-80f8-5af88b544357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:21.029489 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:21.031964 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-5e61dada-e0ad-48b3-80f8-5af88b544357 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:21.033698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-5e61dada-e0ad-48b3-80f8-5af88b544357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:21.037555 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e763a49-6a06-4696-950e-a9fa1beead72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:21.038165 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e763a49-6a06-4696-950e-a9fa1beead72 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:21.038450 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e763a49-6a06-4696-950e-a9fa1beead72 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:21.038724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e763a49-6a06-4696-950e-a9fa1beead72 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:21.039426 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e763a49-6a06-4696-950e-a9fa1beead72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:21.039731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e763a49-6a06-4696-950e-a9fa1beead72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:21.041115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e763a49-6a06-4696-950e-a9fa1beead72 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:21.050002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 26/51] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:21.055539 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e763a49-6a06-4696-950e-a9fa1beead72 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:21.103921 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 26/52] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:00:21.155789 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e763a49-6a06-4696-950e-a9fa1beead72 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:21.188435 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5440-2acb-4ceb-9222-87778817c223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:21.189059 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5440-2acb-4ceb-9222-87778817c223 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:21.189346 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5440-2acb-4ceb-9222-87778817c223 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:21.189626 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5440-2acb-4ceb-9222-87778817c223 None admin] PATH_INFO: `/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:21.190755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da5440-2acb-4ceb-9222-87778817c223 None admin] RBAC: Authorizing `identity:get_user(user_id=71471eb8a3e6483ebb3f0a3b9d99aedd)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:21.192229 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da5440-2acb-4ceb-9222-87778817c223 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:21.193794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:21 2022] GET /identity/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:21.199346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61dada-e0ad-48b3-80f8-5af88b544357 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:21.211346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:21.298575 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61dada-e0ad-48b3-80f8-5af88b544357 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:21.331100 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89097505-de51-4814-ab43-8a1e74dc58fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:21.331757 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89097505-de51-4814-ab43-8a1e74dc58fd None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:21.332039 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89097505-de51-4814-ab43-8a1e74dc58fd None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:21.332314 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89097505-de51-4814-ab43-8a1e74dc58fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:21.333426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89097505-de51-4814-ab43-8a1e74dc58fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:21.334855 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89097505-de51-4814-ab43-8a1e74dc58fd None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:21.336425 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 27/54] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:21.342152 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5440-2acb-4ceb-9222-87778817c223 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:21.400746 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:21.427726 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89097505-de51-4814-ab43-8a1e74dc58fd None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:21.443655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5440-2acb-4ceb-9222-87778817c223 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:21.477029 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360be2d-e085-4903-a8d7-b6bbcf229443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:21.477642 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360be2d-e085-4903-a8d7-b6bbcf229443 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:21.477930 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360be2d-e085-4903-a8d7-b6bbcf229443 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:21.478204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360be2d-e085-4903-a8d7-b6bbcf229443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:21.478924 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360be2d-e085-4903-a8d7-b6bbcf229443 None admin] RBAC: Adding query filter params (role.id=49c7d15532d94cafac420a6bcf8574ad, scope.domain.id=default, user.id=71471eb8a3e6483ebb3f0a3b9d99aedd) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:21.479239 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360be2d-e085-4903-a8d7-b6bbcf229443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:21.481248 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360be2d-e085-4903-a8d7-b6bbcf229443 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:21.488312 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Aug 18 21:00:21 2022] GET /identity/v3/role_assignments?user.id=71471eb8a3e6483ebb3f0a3b9d99aedd&scope.domain.id=default&role.id=49c7d15532d94cafac420a6bcf8574ad => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:21.507388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:21.531979 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89097505-de51-4814-ab43-8a1e74dc58fd None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:21.567904 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a527d3b-23c9-4d9e-8f50-32885bb6043c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:21.568545 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a527d3b-23c9-4d9e-8f50-32885bb6043c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:21.568828 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a527d3b-23c9-4d9e-8f50-32885bb6043c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:21.569102 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a527d3b-23c9-4d9e-8f50-32885bb6043c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:21.570246 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a527d3b-23c9-4d9e-8f50-32885bb6043c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:21.571757 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a527d3b-23c9-4d9e-8f50-32885bb6043c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:21.573402 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 28/56] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:21.580281 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360be2d-e085-4903-a8d7-b6bbcf229443 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:21.686916 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360be2d-e085-4903-a8d7-b6bbcf229443 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:21.709913 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:21.726112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436851b-305e-4d42-93cc-128f9ae61e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:21.726737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436851b-305e-4d42-93cc-128f9ae61e90 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:21.727145 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436851b-305e-4d42-93cc-128f9ae61e90 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:21.727549 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436851b-305e-4d42-93cc-128f9ae61e90 None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:21.728255 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436851b-305e-4d42-93cc-128f9ae61e90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:21.730500 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436851b-305e-4d42-93cc-128f9ae61e90 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:21.756806 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 29/57] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Aug 18 21:00:21 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:00:23.911821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edc43b-9954-4929-b22d-648d1861e43f None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:23.912328 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edc43b-9954-4929-b22d-648d1861e43f None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:23.912328 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edc43b-9954-4929-b22d-648d1861e43f None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:23.913624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 29/58] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:23.919016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f323-aebb-4445-ae8a-bd60feec262d None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:23.919438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f323-aebb-4445-ae8a-bd60feec262d None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:23.919617 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f323-aebb-4445-ae8a-bd60feec262d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:23.937517 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-5b14f323-aebb-4445-ae8a-bd60feec262d None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:23.938717 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-5b14f323-aebb-4445-ae8a-bd60feec262d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:24.002598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:24.337556 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edc43b-9954-4929-b22d-648d1861e43f None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:24.435172 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edc43b-9954-4929-b22d-648d1861e43f None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:24.469210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14a246-93eb-4ad5-808e-f24c29c059d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:24.469815 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14a246-93eb-4ad5-808e-f24c29c059d7 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:24.470094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14a246-93eb-4ad5-808e-f24c29c059d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:24.470366 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14a246-93eb-4ad5-808e-f24c29c059d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:24.471500 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14a246-93eb-4ad5-808e-f24c29c059d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:24.472942 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14a246-93eb-4ad5-808e-f24c29c059d7 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:24.474453 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 30/60] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:24.480087 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14f323-aebb-4445-ae8a-bd60feec262d None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:24.576523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14f323-aebb-4445-ae8a-bd60feec262d None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:24.579232 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:24.612372 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05797b13-3768-48f2-849c-e6d308034603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:24.613000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05797b13-3768-48f2-849c-e6d308034603 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:24.613281 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05797b13-3768-48f2-849c-e6d308034603 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:24.613554 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05797b13-3768-48f2-849c-e6d308034603 None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:24.614201 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05797b13-3768-48f2-849c-e6d308034603 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:24.615702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05797b13-3768-48f2-849c-e6d308034603 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:24.642573 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Aug 18 21:00:24 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:00:27.910830 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c737f-14db-42e7-b4c7-6d48e3bce11f None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:27.911818 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c737f-14db-42e7-b4c7-6d48e3bce11f None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:27.912307 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c737f-14db-42e7-b4c7-6d48e3bce11f None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:27.913851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 31/62] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:00:27.919211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae2ea6-42b6-477a-8447-1c8477d65e86 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:27.919628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae2ea6-42b6-477a-8447-1c8477d65e86 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:27.919797 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae2ea6-42b6-477a-8447-1c8477d65e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:27.948727 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-87ae2ea6-42b6-477a-8447-1c8477d65e86 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:27.950172 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-87ae2ea6-42b6-477a-8447-1c8477d65e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:28.045126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:28.091770 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141ef74-8bf9-4f42-a538-28c100a9cf58 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:28.092393 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141ef74-8bf9-4f42-a538-28c100a9cf58 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:28.092891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141ef74-8bf9-4f42-a538-28c100a9cf58 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:28.094455 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 32/64] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:28.101049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3c18-a359-4594-aa25-336dc0522e0c None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:28.101347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3c18-a359-4594-aa25-336dc0522e0c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:28.101614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3c18-a359-4594-aa25-336dc0522e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:28.131887 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-767c3c18-a359-4594-aa25-336dc0522e0c None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:28.133124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-767c3c18-a359-4594-aa25-336dc0522e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:28.223845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 33/65] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:28.264770 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32f259-2c1e-45f0-b5bd-8f0fa41d4766 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:28.265371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32f259-2c1e-45f0-b5bd-8f0fa41d4766 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:28.265838 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32f259-2c1e-45f0-b5bd-8f0fa41d4766 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:28.267415 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 33/66] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:28.272487 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea735fb-7c09-4ae7-90d5-9ced09296f19 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:28.272774 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea735fb-7c09-4ae7-90d5-9ced09296f19 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:28.273039 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea735fb-7c09-4ae7-90d5-9ced09296f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:28.297769 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-fea735fb-7c09-4ae7-90d5-9ced09296f19 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:28.298960 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-fea735fb-7c09-4ae7-90d5-9ced09296f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:28.318155 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:28.392578 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:28.431310 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32f259-2c1e-45f0-b5bd-8f0fa41d4766 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:28.456424 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:28.568354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32f259-2c1e-45f0-b5bd-8f0fa41d4766 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:28.604940 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea735fb-7c09-4ae7-90d5-9ced09296f19 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:28.628024 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad1a76-91be-481b-9311-86103111781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:28.628989 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad1a76-91be-481b-9311-86103111781b None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:28.629487 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad1a76-91be-481b-9311-86103111781b None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:28.629972 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad1a76-91be-481b-9311-86103111781b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:28.641460 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad1a76-91be-481b-9311-86103111781b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-c4ad1a76-91be-481b-9311-86103111781b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:28.646497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:28.647442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:28.648204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:28.648204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:28.648204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:28.648204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:28.648204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:28.648204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:28.648204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:28.648204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:28.648204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:28.648204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:28.648204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:28.648204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:28.650735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 34/68] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:00:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:28.659292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad1a76-91be-481b-9311-86103111781b None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:28.755722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea735fb-7c09-4ae7-90d5-9ced09296f19 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:28.772923 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:28.792195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc93d4-f4f6-4138-a621-33139a57176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:28.792847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc93d4-f4f6-4138-a621-33139a57176f None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:28.793131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc93d4-f4f6-4138-a621-33139a57176f None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:28.793409 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc93d4-f4f6-4138-a621-33139a57176f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:28.798885 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad1a76-91be-481b-9311-86103111781b None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:28.806610 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc93d4-f4f6-4138-a621-33139a57176f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-e0bc93d4-f4f6-4138-a621-33139a57176f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:28.812269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:28.813212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:28.813951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:28.813951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:28.813951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:28.813951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:28.813951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:28.813951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:28.813951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:28.813951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:28.813951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:28.813951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:28.813951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:28.813951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:28.813951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:28.815377 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924d3f1-a3ca-4e84-950b-03cfa0039adf None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:28.815670 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924d3f1-a3ca-4e84-950b-03cfa0039adf None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:28.815946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924d3f1-a3ca-4e84-950b-03cfa0039adf None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:28.817513 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 36/70] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:28.818457 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924d3f1-a3ca-4e84-950b-03cfa0039adf None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:28.833907 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:28.850383 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b83532-f49a-416e-aa76-780d80d3baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:28.850989 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b83532-f49a-416e-aa76-780d80d3baa3 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:28.851283 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b83532-f49a-416e-aa76-780d80d3baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:28.851577 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b83532-f49a-416e-aa76-780d80d3baa3 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:28.852238 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b83532-f49a-416e-aa76-780d80d3baa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:28.852542 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b83532-f49a-416e-aa76-780d80d3baa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:28.853957 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b83532-f49a-416e-aa76-780d80d3baa3 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:28.862915 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:28.867616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b83532-f49a-416e-aa76-780d80d3baa3 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:28.938589 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924d3f1-a3ca-4e84-950b-03cfa0039adf None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:28.970007 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b83532-f49a-416e-aa76-780d80d3baa3 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:28.974691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c558931-bf05-4843-8a6d-68cc02b4e01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:28.975350 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c558931-bf05-4843-8a6d-68cc02b4e01b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:28.975634 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c558931-bf05-4843-8a6d-68cc02b4e01b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:28.975905 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c558931-bf05-4843-8a6d-68cc02b4e01b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:28.986351 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c558931-bf05-4843-8a6d-68cc02b4e01b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-1c558931-bf05-4843-8a6d-68cc02b4e01b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:28.991110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:28.991969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 37/72] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:00:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:28.997859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b8153-d8d1-4e38-9775-00bd203cc9f5 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:28.998541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b8153-d8d1-4e38-9775-00bd203cc9f5 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:28.998541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b8153-d8d1-4e38-9775-00bd203cc9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:29.003904 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e83977-9b88-4b01-b7e5-0d778dfc7753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:29.004516 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e83977-9b88-4b01-b7e5-0d778dfc7753 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:29.004800 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e83977-9b88-4b01-b7e5-0d778dfc7753 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:29.005080 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e83977-9b88-4b01-b7e5-0d778dfc7753 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:29.005739 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e83977-9b88-4b01-b7e5-0d778dfc7753 None admin] RBAC: Adding query filter params (name=member) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:29.006049 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e83977-9b88-4b01-b7e5-0d778dfc7753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:29.007444 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e83977-9b88-4b01-b7e5-0d778dfc7753 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:29.009797 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:29.012211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-2e5b8153-d8d1-4e38-9775-00bd203cc9f5 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:29.013830 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-2e5b8153-d8d1-4e38-9775-00bd203cc9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:29.018319 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:29.025145 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e83977-9b88-4b01-b7e5-0d778dfc7753 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:29.078121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:29.083532 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 38/74] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:29.084831 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd5ef3-ffd7-4ebb-8858-aeff9fb5553d None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:29.085123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd5ef3-ffd7-4ebb-8858-aeff9fb5553d None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:29.085408 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd5ef3-ffd7-4ebb-8858-aeff9fb5553d None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:29.086665 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 39/75] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:29.090889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd5ef3-ffd7-4ebb-8858-aeff9fb5553d None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:29.126131 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e83977-9b88-4b01-b7e5-0d778dfc7753 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:29.162088 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e624f8-782b-4fa4-9fc6-126ff90b662c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:29.162774 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e624f8-782b-4fa4-9fc6-126ff90b662c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:29.163041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e624f8-782b-4fa4-9fc6-126ff90b662c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:29.163394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e624f8-782b-4fa4-9fc6-126ff90b662c None admin] PATH_INFO: `/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:29.164537 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e624f8-782b-4fa4-9fc6-126ff90b662c None admin] RBAC: Authorizing `identity:get_user(user_id=71471eb8a3e6483ebb3f0a3b9d99aedd)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:29.165965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e624f8-782b-4fa4-9fc6-126ff90b662c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:29.168168 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 37/76] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:29 2022] GET /identity/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:29.168928 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e624f8-782b-4fa4-9fc6-126ff90b662c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:29.216360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd5ef3-ffd7-4ebb-8858-aeff9fb5553d None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:29.240433 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:29.253982 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829278d-d626-43d2-80ab-37856be5b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:29.254591 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829278d-d626-43d2-80ab-37856be5b679 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:29.255177 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829278d-d626-43d2-80ab-37856be5b679 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:29.255486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829278d-d626-43d2-80ab-37856be5b679 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:29.256307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829278d-d626-43d2-80ab-37856be5b679 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:29.256611 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829278d-d626-43d2-80ab-37856be5b679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:29.258076 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829278d-d626-43d2-80ab-37856be5b679 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:29.266512 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 40/77] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:00:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:29.272091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09106e6-6a93-44a0-9658-24d05915e6a7 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:29.272554 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09106e6-6a93-44a0-9658-24d05915e6a7 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:29.272659 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09106e6-6a93-44a0-9658-24d05915e6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:29.278819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e624f8-782b-4fa4-9fc6-126ff90b662c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:29.290664 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-a09106e6-6a93-44a0-9658-24d05915e6a7 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:29.291974 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-a09106e6-6a93-44a0-9658-24d05915e6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:29.315217 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58181e2-41e3-4075-94c5-be6a141dbe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:29.315888 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58181e2-41e3-4075-94c5-be6a141dbe91 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:29.316171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58181e2-41e3-4075-94c5-be6a141dbe91 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:29.316449 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58181e2-41e3-4075-94c5-be6a141dbe91 None admin] PATH_INFO: `/v3/users/045909bc53cf41cc804f18ddc4d94d3c` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:29.333304 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58181e2-41e3-4075-94c5-be6a141dbe91 None admin] RBAC: Authorizing `identity:get_user(user_id=045909bc53cf41cc804f18ddc4d94d3c)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:29.334690 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58181e2-41e3-4075-94c5-be6a141dbe91 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:29.341383 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 38/78] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:29 2022] GET /identity/v3/users/045909bc53cf41cc804f18ddc4d94d3c => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:29.341383 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58181e2-41e3-4075-94c5-be6a141dbe91 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:29.358909 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:29.372375 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 41/79] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:29.380154 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09106e6-6a93-44a0-9658-24d05915e6a7 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:29.447323 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58181e2-41e3-4075-94c5-be6a141dbe91 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:29.473247 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:29.487523 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770424f-f5d4-478c-aa21-63b971212b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:29.488157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770424f-f5d4-478c-aa21-63b971212b42 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:29.488417 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770424f-f5d4-478c-aa21-63b971212b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:29.488698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770424f-f5d4-478c-aa21-63b971212b42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:29.490913 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09106e6-6a93-44a0-9658-24d05915e6a7 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:29.527672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0784eb2-9408-45e3-889b-a9684ad980fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:29.528590 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784eb2-9408-45e3-889b-a9684ad980fd None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:29.529041 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784eb2-9408-45e3-889b-a9684ad980fd None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:29.529486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784eb2-9408-45e3-889b-a9684ad980fd None admin] PATH_INFO: `/v3/users/045909bc53cf41cc804f18ddc4d94d3c` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:29.530811 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0784eb2-9408-45e3-889b-a9684ad980fd None admin] RBAC: Authorizing `identity:get_user(user_id=045909bc53cf41cc804f18ddc4d94d3c)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:29.532578 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0784eb2-9408-45e3-889b-a9684ad980fd None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:29.534430 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 42/80] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:29 2022] GET /identity/v3/users/045909bc53cf41cc804f18ddc4d94d3c => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:29.539852 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0784eb2-9408-45e3-889b-a9684ad980fd None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:29.559158 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770424f-f5d4-478c-aa21-63b971212b42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:29.560666 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770424f-f5d4-478c-aa21-63b971212b42 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:29.611022 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:29.651910 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0784eb2-9408-45e3-889b-a9684ad980fd None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:29.674560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 39/81] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:29.675780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770424f-f5d4-478c-aa21-63b971212b42 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:29.690466 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a6f9f-bd9a-400b-8903-bc74ef3dba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:29.691070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a6f9f-bd9a-400b-8903-bc74ef3dba81 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:29.691378 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a6f9f-bd9a-400b-8903-bc74ef3dba81 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:29.691652 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a6f9f-bd9a-400b-8903-bc74ef3dba81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:29.705920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:29.761004 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a6f9f-bd9a-400b-8903-bc74ef3dba81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:29.762497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a6f9f-bd9a-400b-8903-bc74ef3dba81 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:29.781096 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770424f-f5d4-478c-aa21-63b971212b42 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:29.815086 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e3976-a043-4344-a889-e1db62bc1316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:29.815764 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e3976-a043-4344-a889-e1db62bc1316 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:29.816043 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e3976-a043-4344-a889-e1db62bc1316 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:29.816312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e3976-a043-4344-a889-e1db62bc1316 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:29.817882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:29.827046 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e3976-a043-4344-a889-e1db62bc1316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-769e3976-a043-4344-a889-e1db62bc1316 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:29.832303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:29.833154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 40/82] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:29.835058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e3976-a043-4344-a889-e1db62bc1316 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:29.864907 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 43/83] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:29.864907 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a6f9f-bd9a-400b-8903-bc74ef3dba81 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:29.918630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:29.936461 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e3976-a043-4344-a889-e1db62bc1316 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:29.958681 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a6f9f-bd9a-400b-8903-bc74ef3dba81 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:29.970433 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f9a6b-f6a9-407b-add1-8c149d1de4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:29.971040 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f9a6b-f6a9-407b-add1-8c149d1de4a4 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:29.971353 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f9a6b-f6a9-407b-add1-8c149d1de4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:29.971654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f9a6b-f6a9-407b-add1-8c149d1de4a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:29.995202 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d5f63-81d7-42ed-a0e5-836f78562c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:29.995853 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d5f63-81d7-42ed-a0e5-836f78562c85 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:29.996136 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d5f63-81d7-42ed-a0e5-836f78562c85 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:29.996410 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d5f63-81d7-42ed-a0e5-836f78562c85 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:29.997543 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d5f63-81d7-42ed-a0e5-836f78562c85 None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:29.998995 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d5f63-81d7-42ed-a0e5-836f78562c85 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:30.000656 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 44/84] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:29 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:30.002594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d5f63-81d7-42ed-a0e5-836f78562c85 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:30.030321 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:30.038837 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f9a6b-f6a9-407b-add1-8c149d1de4a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:30.040438 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f9a6b-f6a9-407b-add1-8c149d1de4a4 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:30.102766 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d5f63-81d7-42ed-a0e5-836f78562c85 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:30.125452 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:30.137560 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861348c-0a0a-4a0d-b01b-307a82c321cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:30.138187 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861348c-0a0a-4a0d-b01b-307a82c321cb None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:30.138477 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861348c-0a0a-4a0d-b01b-307a82c321cb None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:30.138750 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861348c-0a0a-4a0d-b01b-307a82c321cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:30.139881 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861348c-0a0a-4a0d-b01b-307a82c321cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:30.141321 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861348c-0a0a-4a0d-b01b-307a82c321cb None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:30.142769 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 41/85] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:30.143121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 45/86] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:30.143629 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f9a6b-f6a9-407b-add1-8c149d1de4a4 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:30.143799 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861348c-0a0a-4a0d-b01b-307a82c321cb None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:30.239758 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f9a6b-f6a9-407b-add1-8c149d1de4a4 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:30.240858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:30.247825 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861348c-0a0a-4a0d-b01b-307a82c321cb None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:30.275254 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387adbff-8f05-46c7-a0b6-0812bcc8489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:30.275885 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387adbff-8f05-46c7-a0b6-0812bcc8489d None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:30.276171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387adbff-8f05-46c7-a0b6-0812bcc8489d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:30.276449 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387adbff-8f05-46c7-a0b6-0812bcc8489d None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:30.277102 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387adbff-8f05-46c7-a0b6-0812bcc8489d None admin] RBAC: Adding query filter params (name=member) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:30.277406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387adbff-8f05-46c7-a0b6-0812bcc8489d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:30.278800 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387adbff-8f05-46c7-a0b6-0812bcc8489d None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:30.280607 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629419d-f1bc-43dc-891d-fbcbfe2322c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:30.281234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629419d-f1bc-43dc-891d-fbcbfe2322c0 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:30.281524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629419d-f1bc-43dc-891d-fbcbfe2322c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:30.281802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629419d-f1bc-43dc-891d-fbcbfe2322c0 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:30.282917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629419d-f1bc-43dc-891d-fbcbfe2322c0 None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:30.284389 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629419d-f1bc-43dc-891d-fbcbfe2322c0 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:30.286029 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 46/87] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:30 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:30.286798 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 42/88] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:30.286909 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629419d-f1bc-43dc-891d-fbcbfe2322c0 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:30.288168 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387adbff-8f05-46c7-a0b6-0812bcc8489d None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:30.338591 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:30.390334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629419d-f1bc-43dc-891d-fbcbfe2322c0 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:30.393096 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387adbff-8f05-46c7-a0b6-0812bcc8489d None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:30.424145 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efd4ef-51e2-4e46-962a-edb38e0107fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:30.424738 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd4ef-51e2-4e46-962a-edb38e0107fc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:30.425020 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd4ef-51e2-4e46-962a-edb38e0107fc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:30.425293 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd4ef-51e2-4e46-962a-edb38e0107fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:30.426010 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efd4ef-51e2-4e46-962a-edb38e0107fc None admin] RBAC: Adding query filter params (role.id=49c7d15532d94cafac420a6bcf8574ad, scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412, user.id=71471eb8a3e6483ebb3f0a3b9d99aedd) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:30.426183 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6b33a-de9b-49f4-8ebb-5e5f2566856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:30.426320 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efd4ef-51e2-4e46-962a-edb38e0107fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:30.426808 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6b33a-de9b-49f4-8ebb-5e5f2566856e None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:30.427096 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6b33a-de9b-49f4-8ebb-5e5f2566856e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:30.427424 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6b33a-de9b-49f4-8ebb-5e5f2566856e None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:30.427799 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efd4ef-51e2-4e46-962a-edb38e0107fc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:30.428569 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6b33a-de9b-49f4-8ebb-5e5f2566856e None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:30.430019 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6b33a-de9b-49f4-8ebb-5e5f2566856e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:30.431887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 43/89] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:30 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:30.433049 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6b33a-de9b-49f4-8ebb-5e5f2566856e None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:30.435313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 47/90] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:30 2022] GET /identity/v3/role_assignments?user.id=71471eb8a3e6483ebb3f0a3b9d99aedd&scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412&role.id=49c7d15532d94cafac420a6bcf8574ad => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:30.435313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efd4ef-51e2-4e46-962a-edb38e0107fc None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:30.467170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:30.553430 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6b33a-de9b-49f4-8ebb-5e5f2566856e None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:30.554478 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efd4ef-51e2-4e46-962a-edb38e0107fc None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:30.568982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:30.594787 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a359e2-1db3-456e-a6c3-1f67dfed736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:30.595801 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a359e2-1db3-456e-a6c3-1f67dfed736d None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:30.596291 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a359e2-1db3-456e-a6c3-1f67dfed736d None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:30.596643 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ee0d4-578d-4046-9c22-dd5db61ad106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:30.596898 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a359e2-1db3-456e-a6c3-1f67dfed736d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:30.597263 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ee0d4-578d-4046-9c22-dd5db61ad106 None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:30.597550 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ee0d4-578d-4046-9c22-dd5db61ad106 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:30.597827 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ee0d4-578d-4046-9c22-dd5db61ad106 None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:30.598358 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a359e2-1db3-456e-a6c3-1f67dfed736d None admin] RBAC: Adding query filter params (role.id=70cebcd047db4003b7016de5c93cab80, scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412, user.id=045909bc53cf41cc804f18ddc4d94d3c) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:30.598861 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a359e2-1db3-456e-a6c3-1f67dfed736d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:30.601518 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ee0d4-578d-4046-9c22-dd5db61ad106 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:30.602720 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a359e2-1db3-456e-a6c3-1f67dfed736d None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:30.603151 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ee0d4-578d-4046-9c22-dd5db61ad106 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:30.611396 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 48/91] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:30 2022] GET /identity/v3/role_assignments?user.id=045909bc53cf41cc804f18ddc4d94d3c&scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412&role.id=70cebcd047db4003b7016de5c93cab80 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:30.611396 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a359e2-1db3-456e-a6c3-1f67dfed736d None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:30.636230 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 44/92] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Aug 18 21:00:30 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:00:30.636906 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ee0d4-578d-4046-9c22-dd5db61ad106 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:30.751736 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:30.768082 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a359e2-1db3-456e-a6c3-1f67dfed736d None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:30.784891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ee0d4-578d-4046-9c22-dd5db61ad106 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:30.822032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e75b8-4b7a-4aab-bd9a-584f8cf3ba65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:30.823501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e75b8-4b7a-4aab-bd9a-584f8cf3ba65 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:30.823799 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e75b8-4b7a-4aab-bd9a-584f8cf3ba65 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:30.824178 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e75b8-4b7a-4aab-bd9a-584f8cf3ba65 None admin] PATH_INFO: `/v3/users/045909bc53cf41cc804f18ddc4d94d3c` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:30.825468 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e75b8-4b7a-4aab-bd9a-584f8cf3ba65 None admin] RBAC: Authorizing `identity:get_user(user_id=045909bc53cf41cc804f18ddc4d94d3c)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:30.826054 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bd710-edc5-47a1-b728-d185a44bec5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:30.826679 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bd710-edc5-47a1-b728-d185a44bec5e None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:30.826959 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e75b8-4b7a-4aab-bd9a-584f8cf3ba65 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:30.827072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bd710-edc5-47a1-b728-d185a44bec5e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:30.827238 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bd710-edc5-47a1-b728-d185a44bec5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:30.828292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bd710-edc5-47a1-b728-d185a44bec5e None admin] RBAC: Adding query filter params (role.id=5d73f21ba2e940f38026b109b9c9e10e, scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412, user.id=045909bc53cf41cc804f18ddc4d94d3c) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:30.828702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bd710-edc5-47a1-b728-d185a44bec5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:30.829147 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 49/93] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:30 2022] GET /identity/v3/users/045909bc53cf41cc804f18ddc4d94d3c => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:30.830207 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bd710-edc5-47a1-b728-d185a44bec5e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:30.836040 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e75b8-4b7a-4aab-bd9a-584f8cf3ba65 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:30.839784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 45/94] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:30 2022] GET /identity/v3/role_assignments?user.id=045909bc53cf41cc804f18ddc4d94d3c&scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412&role.id=5d73f21ba2e940f38026b109b9c9e10e => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:30.961015 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e75b8-4b7a-4aab-bd9a-584f8cf3ba65 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:31.003142 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cd3b7-9877-42ef-bac2-8dec89bc81fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:31.003724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cd3b7-9877-42ef-bac2-8dec89bc81fe None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:31.004014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cd3b7-9877-42ef-bac2-8dec89bc81fe None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:31.004295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cd3b7-9877-42ef-bac2-8dec89bc81fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:31.038310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:31.085030 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2cd3b7-9877-42ef-bac2-8dec89bc81fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:31.086524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2cd3b7-9877-42ef-bac2-8dec89bc81fe None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:31.203545 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 50/95] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 21:00:31.209360 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bd710-edc5-47a1-b728-d185a44bec5e None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:31.250061 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:31.325798 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bd710-edc5-47a1-b728-d185a44bec5e None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:31.369134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b88ec9-a2a5-42e6-bdca-649c2c319fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:31.369853 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b88ec9-a2a5-42e6-bdca-649c2c319fe2 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:31.370145 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b88ec9-a2a5-42e6-bdca-649c2c319fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:31.370426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b88ec9-a2a5-42e6-bdca-649c2c319fe2 None admin] PATH_INFO: `/v3/projects/37b8c49b089d4a4bbf2384e1e3f595aa` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:31.371623 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b88ec9-a2a5-42e6-bdca-649c2c319fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=37b8c49b089d4a4bbf2384e1e3f595aa)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:31.373185 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b88ec9-a2a5-42e6-bdca-649c2c319fe2 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:31.375081 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 46/96] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:31 2022] GET /identity/v3/projects/37b8c49b089d4a4bbf2384e1e3f595aa => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:31.381004 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cd3b7-9877-42ef-bac2-8dec89bc81fe None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:31.445571 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:31.498153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cd3b7-9877-42ef-bac2-8dec89bc81fe None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:31.543977 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed56d3b-bdbe-49ee-84ec-803b7c193029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:31.544592 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed56d3b-bdbe-49ee-84ec-803b7c193029 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:31.544875 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed56d3b-bdbe-49ee-84ec-803b7c193029 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:31.545149 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed56d3b-bdbe-49ee-84ec-803b7c193029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:31.545888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed56d3b-bdbe-49ee-84ec-803b7c193029 None admin] RBAC: Adding query filter params (role.id=70cebcd047db4003b7016de5c93cab80, scope.project.id=37b8c49b089d4a4bbf2384e1e3f595aa, user.id=045909bc53cf41cc804f18ddc4d94d3c) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:31.546201 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed56d3b-bdbe-49ee-84ec-803b7c193029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:31.547694 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed56d3b-bdbe-49ee-84ec-803b7c193029 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:31.553598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 51/97] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:31 2022] GET /identity/v3/role_assignments?user.id=045909bc53cf41cc804f18ddc4d94d3c&scope.project.id=37b8c49b089d4a4bbf2384e1e3f595aa&role.id=70cebcd047db4003b7016de5c93cab80 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:33.449293 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f558ddb-6941-4c1d-9f04-dd5ff9926a59 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:33.449800 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f558ddb-6941-4c1d-9f04-dd5ff9926a59 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:33.449874 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f558ddb-6941-4c1d-9f04-dd5ff9926a59 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:33.451182 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 47/98] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:33.465217 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddfb1a-c4f1-42c6-91dd-72deeb285f2f None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:33.465712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddfb1a-c4f1-42c6-91dd-72deeb285f2f None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:33.465810 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddfb1a-c4f1-42c6-91dd-72deeb285f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:33.487397 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-6fddfb1a-c4f1-42c6-91dd-72deeb285f2f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:33.488616 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-6fddfb1a-c4f1-42c6-91dd-72deeb285f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:33.567368 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248655fa-5bbe-4c31-b737-61da97f508c3 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:33.567715 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248655fa-5bbe-4c31-b737-61da97f508c3 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:33.567938 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248655fa-5bbe-4c31-b737-61da97f508c3 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:33.569281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 48/99] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:00:33.574520 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bfa3f-21cb-4c21-9e85-7d5434fda858 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:33.574860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bfa3f-21cb-4c21-9e85-7d5434fda858 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:33.578448 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bfa3f-21cb-4c21-9e85-7d5434fda858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:33.600859 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-b09bfa3f-21cb-4c21-9e85-7d5434fda858 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:33.601879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-b09bfa3f-21cb-4c21-9e85-7d5434fda858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:33.610730 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 52/100] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:33.685801 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 49/101] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 18 21:00:34.049304 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddfb1a-c4f1-42c6-91dd-72deeb285f2f None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:34.108258 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:34.159438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddfb1a-c4f1-42c6-91dd-72deeb285f2f None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:34.204148 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8ce73-a31f-49c8-bed0-15880324ba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:34.205121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8ce73-a31f-49c8-bed0-15880324ba2c None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:34.205631 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8ce73-a31f-49c8-bed0-15880324ba2c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:34.206099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8ce73-a31f-49c8-bed0-15880324ba2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.223918 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8ce73-a31f-49c8-bed0-15880324ba2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-82a8ce73-a31f-49c8-bed0-15880324ba2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:34.229945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:34.230802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:34.231676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:34.231676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:34.231676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:34.231676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:34.231676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:34.231676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:34.231676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:34.231676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:34.231676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:34.231676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:34.231676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:34.231676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:34.234305 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 53/102] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:34.244419 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bfa3f-21cb-4c21-9e85-7d5434fda858 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:34.283203 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:34.294195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8ce73-a31f-49c8-bed0-15880324ba2c None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:34.366588 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bfa3f-21cb-4c21-9e85-7d5434fda858 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:34.403714 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83ac40-832d-4e26-bb4d-436619ab8cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:34.404330 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ac40-832d-4e26-bb4d-436619ab8cee None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:34.404616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ac40-832d-4e26-bb4d-436619ab8cee None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:34.404893 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ac40-832d-4e26-bb4d-436619ab8cee None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.405562 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83ac40-832d-4e26-bb4d-436619ab8cee None admin] RBAC: Adding query filter params (name=member) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:34.405867 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83ac40-832d-4e26-bb4d-436619ab8cee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:34.407248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83ac40-832d-4e26-bb4d-436619ab8cee None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:34.415781 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 50/103] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:34.417725 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55ddb9-cf8a-4d8a-9307-f3ee1ad16f32 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:34.418021 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55ddb9-cf8a-4d8a-9307-f3ee1ad16f32 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:34.418301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55ddb9-cf8a-4d8a-9307-f3ee1ad16f32 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.419702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 51/104] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:34.421927 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8ce73-a31f-49c8-bed0-15880324ba2c None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:34.424261 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55ddb9-cf8a-4d8a-9307-f3ee1ad16f32 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:34.437059 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:34.458307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49864ce-3d87-4aee-a7bf-1ca4820fd89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:34.458941 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49864ce-3d87-4aee-a7bf-1ca4820fd89e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:34.459290 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49864ce-3d87-4aee-a7bf-1ca4820fd89e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:34.459581 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49864ce-3d87-4aee-a7bf-1ca4820fd89e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.470976 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49864ce-3d87-4aee-a7bf-1ca4820fd89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-e49864ce-3d87-4aee-a7bf-1ca4820fd89e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:34.476016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:34.476889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:34.478072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:34.478072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:34.478072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:34.478072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:34.478072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:34.478072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:34.478072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:34.478072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:34.478072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:34.478072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:34.478072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:34.478072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:34.478072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 54/105] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:00:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:34.479541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f21206-7655-4fda-867e-bcabdd59ce64 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:34.479541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f21206-7655-4fda-867e-bcabdd59ce64 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:34.479825 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f21206-7655-4fda-867e-bcabdd59ce64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.498697 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-b1f21206-7655-4fda-867e-bcabdd59ce64 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:34.499939 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-b1f21206-7655-4fda-867e-bcabdd59ce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:34.539395 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:34.550155 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55ddb9-cf8a-4d8a-9307-f3ee1ad16f32 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:34.593180 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 55/106] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:34.598242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b73da7-0e48-4cba-b1ce-2a367fc4ff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:34.598242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b73da7-0e48-4cba-b1ce-2a367fc4ff50 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:34.598242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b73da7-0e48-4cba-b1ce-2a367fc4ff50 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:34.598242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b73da7-0e48-4cba-b1ce-2a367fc4ff50 None admin] PATH_INFO: `/v3/users/045909bc53cf41cc804f18ddc4d94d3c` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.598522 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b73da7-0e48-4cba-b1ce-2a367fc4ff50 None admin] RBAC: Authorizing `identity:get_user(user_id=045909bc53cf41cc804f18ddc4d94d3c)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:34.598522 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b73da7-0e48-4cba-b1ce-2a367fc4ff50 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:34.599810 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f21206-7655-4fda-867e-bcabdd59ce64 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:34.602207 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 52/107] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:34 2022] GET /identity/v3/users/045909bc53cf41cc804f18ddc4d94d3c => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:34.604300 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d846c-27a1-4646-abf9-3e925c495a08 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:34.604881 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d846c-27a1-4646-abf9-3e925c495a08 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:34.605411 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d846c-27a1-4646-abf9-3e925c495a08 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.607047 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 53/108] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:34.608733 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507cec4-becf-4c91-853f-cafc7110fb2e None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:34.609222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507cec4-becf-4c91-853f-cafc7110fb2e None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:34.609697 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507cec4-becf-4c91-853f-cafc7110fb2e None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.611096 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 54/109] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:34.616053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507cec4-becf-4c91-853f-cafc7110fb2e None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:34.728114 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507cec4-becf-4c91-853f-cafc7110fb2e None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:34.734124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f21206-7655-4fda-867e-bcabdd59ce64 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:34.736955 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:34.764020 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615105ad-f379-4f39-a24c-b7865155ea53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:34.764456 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615105ad-f379-4f39-a24c-b7865155ea53 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:34.764741 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615105ad-f379-4f39-a24c-b7865155ea53 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:34.765021 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615105ad-f379-4f39-a24c-b7865155ea53 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.766150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615105ad-f379-4f39-a24c-b7865155ea53 None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:34.767651 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615105ad-f379-4f39-a24c-b7865155ea53 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:34.773971 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 55/110] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:34 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:34.773971 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169d473-0306-4e01-a386-f0036ca6df39 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:34.773971 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169d473-0306-4e01-a386-f0036ca6df39 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:34.773971 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169d473-0306-4e01-a386-f0036ca6df39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.782249 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bd3dc-c720-46ea-b69a-de3dd1731b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:34.783181 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bd3dc-c720-46ea-b69a-de3dd1731b34 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:34.783676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bd3dc-c720-46ea-b69a-de3dd1731b34 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:34.784133 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bd3dc-c720-46ea-b69a-de3dd1731b34 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.785068 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bd3dc-c720-46ea-b69a-de3dd1731b34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:34.785515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bd3dc-c720-46ea-b69a-de3dd1731b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:34.787105 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bd3dc-c720-46ea-b69a-de3dd1731b34 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:34.789853 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-a169d473-0306-4e01-a386-f0036ca6df39 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:34.791645 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-a169d473-0306-4e01-a386-f0036ca6df39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:34.798490 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 56/111] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:34.804594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e186-7e48-45b5-987d-1783ad5c325a None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:34.805089 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e186-7e48-45b5-987d-1783ad5c325a None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:34.805637 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e186-7e48-45b5-987d-1783ad5c325a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.817119 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:34.829160 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-98b9e186-7e48-45b5-987d-1783ad5c325a None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:34.830829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-98b9e186-7e48-45b5-987d-1783ad5c325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:34.862970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 56/112] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:34.869092 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169d473-0306-4e01-a386-f0036ca6df39 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:34.926856 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 57/113] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:34.928153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9e186-7e48-45b5-987d-1783ad5c325a None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:34.988525 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169d473-0306-4e01-a386-f0036ca6df39 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:35.042378 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:35.049734 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9e186-7e48-45b5-987d-1783ad5c325a None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:35.058027 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c3155-a69b-4db6-92b8-5c95b2732680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:35.058771 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c3155-a69b-4db6-92b8-5c95b2732680 None admin] REQUEST_METHOD: `PUT` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:35.059056 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c3155-a69b-4db6-92b8-5c95b2732680 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:35.059383 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c3155-a69b-4db6-92b8-5c95b2732680 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412/users/045909bc53cf41cc804f18ddc4d94d3c/roles/70cebcd047db4003b7016de5c93cab80` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:35.061371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c3155-a69b-4db6-92b8-5c95b2732680 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa7e7bc5516444f2be8b5dae7b0c4412, user_id=045909bc53cf41cc804f18ddc4d94d3c, role_id=70cebcd047db4003b7016de5c93cab80)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:35.062844 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c3155-a69b-4db6-92b8-5c95b2732680 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:35.090508 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598c728-f038-46e4-a6b1-77282a87e7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:35.091657 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598c728-f038-46e4-a6b1-77282a87e7fc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:35.092128 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598c728-f038-46e4-a6b1-77282a87e7fc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:35.092648 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598c728-f038-46e4-a6b1-77282a87e7fc None admin] PATH_INFO: `/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:35.094041 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598c728-f038-46e4-a6b1-77282a87e7fc None admin] RBAC: Authorizing `identity:get_user(user_id=71471eb8a3e6483ebb3f0a3b9d99aedd)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:35.094672 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 57/114] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:00:34 2022] PUT /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412/users/045909bc53cf41cc804f18ddc4d94d3c/roles/70cebcd047db4003b7016de5c93cab80 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:00:35.095555 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c3155-a69b-4db6-92b8-5c95b2732680 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:35.100926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598c728-f038-46e4-a6b1-77282a87e7fc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:35.103419 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 58/115] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:34 2022] GET /identity/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:35.110097 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598c728-f038-46e4-a6b1-77282a87e7fc None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:35.142028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:35.249971 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c3155-a69b-4db6-92b8-5c95b2732680 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:35.272927 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598c728-f038-46e4-a6b1-77282a87e7fc None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:35.323073 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c730c-5bd4-4d90-b97d-404d02f4d992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:35.324063 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c730c-5bd4-4d90-b97d-404d02f4d992 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:35.324347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c730c-5bd4-4d90-b97d-404d02f4d992 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:35.324443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca2956-4340-4694-b361-b3f5ff7d2436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:35.324640 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c730c-5bd4-4d90-b97d-404d02f4d992 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:35.325030 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca2956-4340-4694-b361-b3f5ff7d2436 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:35.325313 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca2956-4340-4694-b361-b3f5ff7d2436 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:35.325584 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca2956-4340-4694-b361-b3f5ff7d2436 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:35.325866 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c730c-5bd4-4d90-b97d-404d02f4d992 None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:35.327696 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c730c-5bd4-4d90-b97d-404d02f4d992 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:35.329344 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 59/116] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:35 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:35.330475 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989626a-c667-4c29-bda2-8e2157909b03 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:35.330758 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989626a-c667-4c29-bda2-8e2157909b03 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:35.331035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989626a-c667-4c29-bda2-8e2157909b03 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:35.336800 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 60/117] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:35.337580 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989626a-c667-4c29-bda2-8e2157909b03 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:35.339420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca2956-4340-4694-b361-b3f5ff7d2436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-09ca2956-4340-4694-b361-b3f5ff7d2436 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:35.348905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:35.349879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 58/118] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:35.350984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca2956-4340-4694-b361-b3f5ff7d2436 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:35.378029 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:35.440578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:35.461555 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca2956-4340-4694-b361-b3f5ff7d2436 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:35.462767 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989626a-c667-4c29-bda2-8e2157909b03 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:35.501203 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466f4ca-d2a7-4d94-8d9f-b8f1c0c7e104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:35.501789 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466f4ca-d2a7-4d94-8d9f-b8f1c0c7e104 None admin] REQUEST_METHOD: `PUT` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:35.502072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466f4ca-d2a7-4d94-8d9f-b8f1c0c7e104 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:35.502348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466f4ca-d2a7-4d94-8d9f-b8f1c0c7e104 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412/users/71471eb8a3e6483ebb3f0a3b9d99aedd/roles/49c7d15532d94cafac420a6bcf8574ad` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:35.504304 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466f4ca-d2a7-4d94-8d9f-b8f1c0c7e104 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa7e7bc5516444f2be8b5dae7b0c4412, user_id=71471eb8a3e6483ebb3f0a3b9d99aedd, role_id=49c7d15532d94cafac420a6bcf8574ad)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:35.505762 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466f4ca-d2a7-4d94-8d9f-b8f1c0c7e104 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:35.506721 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a330f-028a-4cb3-ade8-f8aa07b9191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:35.507451 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a330f-028a-4cb3-ade8-f8aa07b9191d None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:35.507817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a330f-028a-4cb3-ade8-f8aa07b9191d None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:35.508175 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a330f-028a-4cb3-ade8-f8aa07b9191d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:35.509374 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a330f-028a-4cb3-ade8-f8aa07b9191d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:35.512569 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a330f-028a-4cb3-ade8-f8aa07b9191d None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:35.513464 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 61/119] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:35.514661 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386eb8c-31b4-4394-bde2-e13d0f0fea75 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:35.514956 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386eb8c-31b4-4394-bde2-e13d0f0fea75 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:35.515234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386eb8c-31b4-4394-bde2-e13d0f0fea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:35.520067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 59/120] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:00:35 2022] PUT /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412/users/71471eb8a3e6483ebb3f0a3b9d99aedd/roles/49c7d15532d94cafac420a6bcf8574ad => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:00:35.527704 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466f4ca-d2a7-4d94-8d9f-b8f1c0c7e104 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:35.545516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-c386eb8c-31b4-4394-bde2-e13d0f0fea75 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:35.546985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-c386eb8c-31b4-4394-bde2-e13d0f0fea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:35.666869 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 62/121] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:35.668048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386eb8c-31b4-4394-bde2-e13d0f0fea75 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:35.687734 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466f4ca-d2a7-4d94-8d9f-b8f1c0c7e104 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:35.710102 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:35.749230 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99545188-7c1c-4871-9e4e-ebf1624f2302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:35.749864 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99545188-7c1c-4871-9e4e-ebf1624f2302 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:35.750152 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99545188-7c1c-4871-9e4e-ebf1624f2302 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:35.750430 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99545188-7c1c-4871-9e4e-ebf1624f2302 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:35.751096 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99545188-7c1c-4871-9e4e-ebf1624f2302 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:35.751512 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99545188-7c1c-4871-9e4e-ebf1624f2302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:35.752856 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99545188-7c1c-4871-9e4e-ebf1624f2302 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:35.770583 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 60/122] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:35.771461 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99545188-7c1c-4871-9e4e-ebf1624f2302 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:35.777152 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:35.819018 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386eb8c-31b4-4394-bde2-e13d0f0fea75 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:35.882757 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f237e-a010-41f6-a7c4-b7defb36f143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:35.884637 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f237e-a010-41f6-a7c4-b7defb36f143 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:35.884950 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f237e-a010-41f6-a7c4-b7defb36f143 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:35.885219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f237e-a010-41f6-a7c4-b7defb36f143 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:35.898032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f237e-a010-41f6-a7c4-b7defb36f143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-575f237e-a010-41f6-a7c4-b7defb36f143 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:35.903536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:35.905307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 63/123] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:00:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:35.906392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f237e-a010-41f6-a7c4-b7defb36f143 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:36.016446 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99545188-7c1c-4871-9e4e-ebf1624f2302 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:36.051689 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:36.079115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f237e-a010-41f6-a7c4-b7defb36f143 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:36.082022 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cc351-817c-4d8e-b1f7-ebb5ee06decc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:36.082648 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cc351-817c-4d8e-b1f7-ebb5ee06decc None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:36.082929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cc351-817c-4d8e-b1f7-ebb5ee06decc None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:36.083202 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cc351-817c-4d8e-b1f7-ebb5ee06decc None admin] PATH_INFO: `/v3/projects` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:36.083880 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cc351-817c-4d8e-b1f7-ebb5ee06decc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:36.085327 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cc351-817c-4d8e-b1f7-ebb5ee06decc None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:36.121314 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60758701-9aa6-4779-8b1c-5302d6e4318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:36.122142 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60758701-9aa6-4779-8b1c-5302d6e4318d None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:36.122431 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60758701-9aa6-4779-8b1c-5302d6e4318d None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:36.122711 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60758701-9aa6-4779-8b1c-5302d6e4318d None admin] PATH_INFO: `/v3/users/31a81cdb227b4f13a2d92360514ffa6f` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:36.133133 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 61/124] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Aug 18 21:00:35 2022] POST /identity/v3/projects => generated 302 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:00:36.134000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cc351-817c-4d8e-b1f7-ebb5ee06decc None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:36.161316 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60758701-9aa6-4779-8b1c-5302d6e4318d None admin] RBAC: Authorizing `identity:get_user(user_id=31a81cdb227b4f13a2d92360514ffa6f)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:36.162813 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60758701-9aa6-4779-8b1c-5302d6e4318d None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:36.166417 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 64/125] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:35 2022] GET /identity/v3/users/31a81cdb227b4f13a2d92360514ffa6f => generated 289 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:36.167284 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60758701-9aa6-4779-8b1c-5302d6e4318d None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:36.219283 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:36.319047 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cc351-817c-4d8e-b1f7-ebb5ee06decc None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:36.370669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60758701-9aa6-4779-8b1c-5302d6e4318d None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:36.389864 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0cf93-d286-4b14-9cb3-f11eda8b2127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:36.391232 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0cf93-d286-4b14-9cb3-f11eda8b2127 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:36.392019 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0cf93-d286-4b14-9cb3-f11eda8b2127 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:36.392499 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0cf93-d286-4b14-9cb3-f11eda8b2127 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:36.393625 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0cf93-d286-4b14-9cb3-f11eda8b2127 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:36.394175 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0cf93-d286-4b14-9cb3-f11eda8b2127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:36.396171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0cf93-d286-4b14-9cb3-f11eda8b2127 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:36.410521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 62/126] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:00:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:36.412056 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0cf93-d286-4b14-9cb3-f11eda8b2127 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:36.428530 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf863ff-99a2-4087-9d3f-233729275b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:36.429602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf863ff-99a2-4087-9d3f-233729275b5f None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:36.430080 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf863ff-99a2-4087-9d3f-233729275b5f None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:36.430548 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf863ff-99a2-4087-9d3f-233729275b5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:36.446898 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf863ff-99a2-4087-9d3f-233729275b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-0bf863ff-99a2-4087-9d3f-233729275b5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:36.452751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:36.453593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:36.454362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:36.454362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:36.454362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:36.454362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:36.454362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:36.454362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:36.454362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:36.454362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:36.454362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:36.454362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:36.454362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:36.454362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:36.456737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 65/127] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:36.457895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf863ff-99a2-4087-9d3f-233729275b5f None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:36.470815 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:36.529218 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0cf93-d286-4b14-9cb3-f11eda8b2127 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:36.546491 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:36.568602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abeb3bc-cbf4-4d8e-af37-d883e8086931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:36.569402 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeb3bc-cbf4-4d8e-af37-d883e8086931 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:36.569524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeb3bc-cbf4-4d8e-af37-d883e8086931 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:36.569738 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeb3bc-cbf4-4d8e-af37-d883e8086931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:36.579671 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf863ff-99a2-4087-9d3f-233729275b5f None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:36.619699 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d436d-566a-4174-b13a-f548b4d8df61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:36.621482 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d436d-566a-4174-b13a-f548b4d8df61 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:36.621978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d436d-566a-4174-b13a-f548b4d8df61 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:36.622463 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d436d-566a-4174-b13a-f548b4d8df61 None admin] PATH_INFO: `/v3/users/045909bc53cf41cc804f18ddc4d94d3c` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:36.624968 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d436d-566a-4174-b13a-f548b4d8df61 None admin] RBAC: Authorizing `identity:get_user(user_id=045909bc53cf41cc804f18ddc4d94d3c)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:36.626670 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d436d-566a-4174-b13a-f548b4d8df61 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:36.628573 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 66/128] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:36 2022] GET /identity/v3/users/045909bc53cf41cc804f18ddc4d94d3c => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:36.630156 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d436d-566a-4174-b13a-f548b4d8df61 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:36.663293 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abeb3bc-cbf4-4d8e-af37-d883e8086931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:36.664789 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abeb3bc-cbf4-4d8e-af37-d883e8086931 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:36.732503 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:36.758749 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d436d-566a-4174-b13a-f548b4d8df61 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:36.797437 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 63/129] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:36.798275 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abeb3bc-cbf4-4d8e-af37-d883e8086931 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:36.806925 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7ed6f-b177-402a-80d9-a5a0327860db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:36.808501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7ed6f-b177-402a-80d9-a5a0327860db None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:36.808501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7ed6f-b177-402a-80d9-a5a0327860db None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:36.812668 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7ed6f-b177-402a-80d9-a5a0327860db None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:36.813942 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7ed6f-b177-402a-80d9-a5a0327860db None admin] RBAC: Adding query filter params (name=member) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:36.814148 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7ed6f-b177-402a-80d9-a5a0327860db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:36.815547 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7ed6f-b177-402a-80d9-a5a0327860db None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:36.831982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:36.835415 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 67/130] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:36.837209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7ed6f-b177-402a-80d9-a5a0327860db None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:36.935289 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abeb3bc-cbf4-4d8e-af37-d883e8086931 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:36.973721 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352acca8-c91f-476c-ba17-0b07edfea402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:36.973721 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352acca8-c91f-476c-ba17-0b07edfea402 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:36.973721 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352acca8-c91f-476c-ba17-0b07edfea402 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:36.973721 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352acca8-c91f-476c-ba17-0b07edfea402 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:36.974120 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352acca8-c91f-476c-ba17-0b07edfea402 None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:36.974120 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352acca8-c91f-476c-ba17-0b07edfea402 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:36.974120 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 64/131] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:36 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:36.974594 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352acca8-c91f-476c-ba17-0b07edfea402 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:37.007858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7ed6f-b177-402a-80d9-a5a0327860db None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:37.067392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f0b22-65ca-4f05-81ab-4c3dc48bedca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:37.068416 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f0b22-65ca-4f05-81ab-4c3dc48bedca None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:37.068930 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f0b22-65ca-4f05-81ab-4c3dc48bedca None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:37.069419 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f0b22-65ca-4f05-81ab-4c3dc48bedca None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:37.075540 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:37.076259 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f0b22-65ca-4f05-81ab-4c3dc48bedca None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:37.077900 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f0b22-65ca-4f05-81ab-4c3dc48bedca None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:37.079794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 68/132] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:36 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:37.080826 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f0b22-65ca-4f05-81ab-4c3dc48bedca None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:37.091125 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:37.098395 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352acca8-c91f-476c-ba17-0b07edfea402 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:37.137401 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2f829-26a5-45fc-8dd1-fef42949e555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:37.138275 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2f829-26a5-45fc-8dd1-fef42949e555 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:37.138835 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2f829-26a5-45fc-8dd1-fef42949e555 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:37.139280 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2f829-26a5-45fc-8dd1-fef42949e555 None admin] PATH_INFO: `/v3/users/045909bc53cf41cc804f18ddc4d94d3c` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:37.140692 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2f829-26a5-45fc-8dd1-fef42949e555 None admin] RBAC: Authorizing `identity:get_user(user_id=045909bc53cf41cc804f18ddc4d94d3c)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:37.142277 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2f829-26a5-45fc-8dd1-fef42949e555 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:37.144123 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 65/133] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:36 2022] GET /identity/v3/users/045909bc53cf41cc804f18ddc4d94d3c => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:37.145378 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2f829-26a5-45fc-8dd1-fef42949e555 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:37.261529 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2f829-26a5-45fc-8dd1-fef42949e555 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:37.261748 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f0b22-65ca-4f05-81ab-4c3dc48bedca None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:37.301385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800655a-fd34-4ed0-b8d4-83dd23f25766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:37.302398 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800655a-fd34-4ed0-b8d4-83dd23f25766 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:37.302844 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800655a-fd34-4ed0-b8d4-83dd23f25766 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:37.303305 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800655a-fd34-4ed0-b8d4-83dd23f25766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:37.304350 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800655a-fd34-4ed0-b8d4-83dd23f25766 None admin] RBAC: Adding query filter params (role.id=9d0c3738e3c94c5db4b0766c5f44fb11, scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412, user.id=31a81cdb227b4f13a2d92360514ffa6f) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:37.304814 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800655a-fd34-4ed0-b8d4-83dd23f25766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:37.307591 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800655a-fd34-4ed0-b8d4-83dd23f25766 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:37.314207 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 66/134] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:37 2022] GET /identity/v3/role_assignments?user.id=31a81cdb227b4f13a2d92360514ffa6f&scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412&role.id=9d0c3738e3c94c5db4b0766c5f44fb11 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:37.315530 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800655a-fd34-4ed0-b8d4-83dd23f25766 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:37.339210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:37.351559 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72341a9b-3c91-4779-b607-f67d23704e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:37.353185 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72341a9b-3c91-4779-b607-f67d23704e40 None admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:37.354316 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72341a9b-3c91-4779-b607-f67d23704e40 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:37.355738 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72341a9b-3c91-4779-b607-f67d23704e40 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412/users/045909bc53cf41cc804f18ddc4d94d3c/roles/5d73f21ba2e940f38026b109b9c9e10e` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:37.359955 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72341a9b-3c91-4779-b607-f67d23704e40 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa7e7bc5516444f2be8b5dae7b0c4412, user_id=045909bc53cf41cc804f18ddc4d94d3c, role_id=5d73f21ba2e940f38026b109b9c9e10e)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:37.362266 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72341a9b-3c91-4779-b607-f67d23704e40 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:37.397158 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 69/135] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:00:37 2022] PUT /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412/users/045909bc53cf41cc804f18ddc4d94d3c/roles/5d73f21ba2e940f38026b109b9c9e10e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:00:37.509065 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800655a-fd34-4ed0-b8d4-83dd23f25766 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:37.566306 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b358f-b211-42e7-abb1-110a24351d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:37.566959 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b358f-b211-42e7-abb1-110a24351d71 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:37.567242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b358f-b211-42e7-abb1-110a24351d71 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:37.567548 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b358f-b211-42e7-abb1-110a24351d71 None admin] PATH_INFO: `/v3/projects/37b8c49b089d4a4bbf2384e1e3f595aa` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:37.568735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b358f-b211-42e7-abb1-110a24351d71 None admin] RBAC: Authorizing `identity:get_project(project_id=37b8c49b089d4a4bbf2384e1e3f595aa)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:37.570233 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b358f-b211-42e7-abb1-110a24351d71 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:37.572279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 67/136] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:37 2022] GET /identity/v3/projects/37b8c49b089d4a4bbf2384e1e3f595aa => generated 312 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:37.581901 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72341a9b-3c91-4779-b607-f67d23704e40 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:37.680441 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:37.721414 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72341a9b-3c91-4779-b607-f67d23704e40 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:37.764395 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7e166-a958-4690-8eef-82d065750c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:37.765091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7e166-a958-4690-8eef-82d065750c49 None admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:37.765383 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7e166-a958-4690-8eef-82d065750c49 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:37.765664 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7e166-a958-4690-8eef-82d065750c49 None admin] PATH_INFO: `/v3/projects/37b8c49b089d4a4bbf2384e1e3f595aa/users/045909bc53cf41cc804f18ddc4d94d3c/roles/70cebcd047db4003b7016de5c93cab80` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:37.772717 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7e166-a958-4690-8eef-82d065750c49 None admin] RBAC: Authorizing `identity:create_grant(project_id=37b8c49b089d4a4bbf2384e1e3f595aa, user_id=045909bc53cf41cc804f18ddc4d94d3c, role_id=70cebcd047db4003b7016de5c93cab80)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:37.774215 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7e166-a958-4690-8eef-82d065750c49 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:37.799450 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 70/137] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:00:37 2022] PUT /identity/v3/projects/37b8c49b089d4a4bbf2384e1e3f595aa/users/045909bc53cf41cc804f18ddc4d94d3c/roles/70cebcd047db4003b7016de5c93cab80 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:00:38.032620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30741aa-4e17-4549-aed2-938d67b672ae None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:38.033151 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30741aa-4e17-4549-aed2-938d67b672ae None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:38.033233 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30741aa-4e17-4549-aed2-938d67b672ae None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:38.034555 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 68/138] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:38.040555 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4638b-2046-45bb-9f55-1ae253bf0cdb None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:38.040860 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4638b-2046-45bb-9f55-1ae253bf0cdb None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:38.041126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4638b-2046-45bb-9f55-1ae253bf0cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:38.060545 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-fde4638b-2046-45bb-9f55-1ae253bf0cdb None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:38.061805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-fde4638b-2046-45bb-9f55-1ae253bf0cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:38.138078 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 71/139] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:38.373697 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0245b-7c80-4436-975f-9a1b1919efc2 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:38.374025 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0245b-7c80-4436-975f-9a1b1919efc2 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:38.374203 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0245b-7c80-4436-975f-9a1b1919efc2 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:38.375549 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 69/140] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:38.380958 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd10ae-4b5c-4e12-bddb-cb1c796030ed None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:38.381265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd10ae-4b5c-4e12-bddb-cb1c796030ed None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:38.381533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd10ae-4b5c-4e12-bddb-cb1c796030ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:38.406531 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-15bd10ae-4b5c-4e12-bddb-cb1c796030ed None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:38.407789 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-15bd10ae-4b5c-4e12-bddb-cb1c796030ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:38.461462 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:38.485656 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 72/141] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:38.501782 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0245b-7c80-4436-975f-9a1b1919efc2 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:38.629784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:38.660112 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0245b-7c80-4436-975f-9a1b1919efc2 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:38.710773 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae5ba1-a73f-439c-9235-516af7109cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:38.711450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae5ba1-a73f-439c-9235-516af7109cd5 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:38.711730 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae5ba1-a73f-439c-9235-516af7109cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:38.712008 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae5ba1-a73f-439c-9235-516af7109cd5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:38.729273 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae5ba1-a73f-439c-9235-516af7109cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-23ae5ba1-a73f-439c-9235-516af7109cd5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:38.734060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:38.734929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:38.735747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:38.735747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:38.735747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:38.735747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:38.735747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:38.735747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:38.735747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:38.735747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:38.735747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:38.735747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:38.735747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:38.735747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:38.735747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 70/142] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:38.743161 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd10ae-4b5c-4e12-bddb-cb1c796030ed None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:38.837201 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae5ba1-a73f-439c-9235-516af7109cd5 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:38.860146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd10ae-4b5c-4e12-bddb-cb1c796030ed None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:38.898154 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30e1cc-2c09-4d1c-a268-c06ab279f5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:38.898689 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30e1cc-2c09-4d1c-a268-c06ab279f5a9 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:38.899099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30e1cc-2c09-4d1c-a268-c06ab279f5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:38.899413 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30e1cc-2c09-4d1c-a268-c06ab279f5a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:38.900620 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30e1cc-2c09-4d1c-a268-c06ab279f5a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:38.900933 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30e1cc-2c09-4d1c-a268-c06ab279f5a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:38.902323 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30e1cc-2c09-4d1c-a268-c06ab279f5a9 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:38.912644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 73/143] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:38.922933 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30e1cc-2c09-4d1c-a268-c06ab279f5a9 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:39.042901 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:39.052548 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae5ba1-a73f-439c-9235-516af7109cd5 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:39.142054 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdcf82-faed-4298-ad50-84907e311f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:39.143092 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdcf82-faed-4298-ad50-84907e311f42 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:39.143604 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdcf82-faed-4298-ad50-84907e311f42 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:39.144085 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdcf82-faed-4298-ad50-84907e311f42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:39.172017 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdcf82-faed-4298-ad50-84907e311f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:39.172590 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30e1cc-2c09-4d1c-a268-c06ab279f5a9 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-dacdcf82-faed-4298-ad50-84907e311f42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:39.177394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:39.178222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:39.179033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:39.179033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:39.179033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:39.179033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:39.179033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:39.179033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:39.179033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:39.179033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:39.179033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:39.179033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:39.179033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:39.179033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:39.179033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 71/144] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:00:39.191114 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdcf82-faed-4298-ad50-84907e311f42 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:39.195080 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:39.251594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be228ca0-08b2-437a-9ef8-ea1c0d28fa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:39.254816 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be228ca0-08b2-437a-9ef8-ea1c0d28fa1b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:39.255367 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be228ca0-08b2-437a-9ef8-ea1c0d28fa1b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:39.255776 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be228ca0-08b2-437a-9ef8-ea1c0d28fa1b None admin] PATH_INFO: `/v3/users/045909bc53cf41cc804f18ddc4d94d3c` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:39.258120 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be228ca0-08b2-437a-9ef8-ea1c0d28fa1b None admin] RBAC: Authorizing `identity:get_user(user_id=045909bc53cf41cc804f18ddc4d94d3c)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:39.261642 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be228ca0-08b2-437a-9ef8-ea1c0d28fa1b None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:39.265396 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 74/145] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:38 2022] GET /identity/v3/users/045909bc53cf41cc804f18ddc4d94d3c => generated 275 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:39.270995 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be228ca0-08b2-437a-9ef8-ea1c0d28fa1b None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:39.367925 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdcf82-faed-4298-ad50-84907e311f42 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:39.413042 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be228ca0-08b2-437a-9ef8-ea1c0d28fa1b None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:39.436252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:39.463409 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a3e30-42ae-4b3b-b68c-da1347b13b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:39.464449 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a3e30-42ae-4b3b-b68c-da1347b13b2c None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:39.464738 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a3e30-42ae-4b3b-b68c-da1347b13b2c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:39.465012 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a3e30-42ae-4b3b-b68c-da1347b13b2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:39.470960 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53174cb-8614-4390-9fff-9ee12a88db2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:39.471609 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53174cb-8614-4390-9fff-9ee12a88db2f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:39.471899 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53174cb-8614-4390-9fff-9ee12a88db2f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:39.472182 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53174cb-8614-4390-9fff-9ee12a88db2f None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:39.472861 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53174cb-8614-4390-9fff-9ee12a88db2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:39.473170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53174cb-8614-4390-9fff-9ee12a88db2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:39.480752 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53174cb-8614-4390-9fff-9ee12a88db2f None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:39.493191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 72/146] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:39.500232 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53174cb-8614-4390-9fff-9ee12a88db2f None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:39.633974 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a3e30-42ae-4b3b-b68c-da1347b13b2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:39.635547 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a3e30-42ae-4b3b-b68c-da1347b13b2c None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:39.655573 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:39.732524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53174cb-8614-4390-9fff-9ee12a88db2f None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:39.808120 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f396bd7-52ad-4bf6-adcf-76f834eae96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:39.808762 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f396bd7-52ad-4bf6-adcf-76f834eae96c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:39.809050 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f396bd7-52ad-4bf6-adcf-76f834eae96c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:39.809418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f396bd7-52ad-4bf6-adcf-76f834eae96c None admin] PATH_INFO: `/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:39.810738 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f396bd7-52ad-4bf6-adcf-76f834eae96c None admin] RBAC: Authorizing `identity:get_user(user_id=71471eb8a3e6483ebb3f0a3b9d99aedd)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:39.812232 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f396bd7-52ad-4bf6-adcf-76f834eae96c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:39.813986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 73/147] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:39 2022] GET /identity/v3/users/71471eb8a3e6483ebb3f0a3b9d99aedd => generated 247 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:39.819122 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31296970-2951-4faa-bf50-d36b6048163b None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:39.821048 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31296970-2951-4faa-bf50-d36b6048163b None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:39.821340 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31296970-2951-4faa-bf50-d36b6048163b None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:39.822806 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 74/148] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:39.826028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31296970-2951-4faa-bf50-d36b6048163b None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:39.840915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 75/149] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 21:00:39.842729 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2f1f8-bd97-49b8-9566-54affa04da0f None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:39.844930 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2f1f8-bd97-49b8-9566-54affa04da0f None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:39.845218 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2f1f8-bd97-49b8-9566-54affa04da0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:39.882598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-36c2f1f8-bd97-49b8-9566-54affa04da0f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:39.883837 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-36c2f1f8-bd97-49b8-9566-54affa04da0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:39.918865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:40.003430 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 76/150] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:40.004232 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2f1f8-bd97-49b8-9566-54affa04da0f None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:40.015912 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31296970-2951-4faa-bf50-d36b6048163b None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:40.084621 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75f456-db05-4a50-9f54-40a375e234da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:40.085258 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75f456-db05-4a50-9f54-40a375e234da None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:40.085534 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75f456-db05-4a50-9f54-40a375e234da None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:40.085789 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75f456-db05-4a50-9f54-40a375e234da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:40.093773 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:40.147744 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2f1f8-bd97-49b8-9566-54affa04da0f None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:40.185681 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db62c8-435a-4677-bf89-32f7504056f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:40.186314 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db62c8-435a-4677-bf89-32f7504056f0 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:40.186597 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db62c8-435a-4677-bf89-32f7504056f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:40.186869 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db62c8-435a-4677-bf89-32f7504056f0 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:40.188155 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db62c8-435a-4677-bf89-32f7504056f0 None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:40.189784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db62c8-435a-4677-bf89-32f7504056f0 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:40.191744 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 77/151] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:40 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:40.198323 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db62c8-435a-4677-bf89-32f7504056f0 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:40.222874 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:40.260784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75f456-db05-4a50-9f54-40a375e234da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:40.262184 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75f456-db05-4a50-9f54-40a375e234da None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:40.307812 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db62c8-435a-4677-bf89-32f7504056f0 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:40.344949 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11121ef-d629-4dc1-b33d-2ed305d911fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:40.345562 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11121ef-d629-4dc1-b33d-2ed305d911fd None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:40.345837 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11121ef-d629-4dc1-b33d-2ed305d911fd None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:40.346109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11121ef-d629-4dc1-b33d-2ed305d911fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:40.346848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11121ef-d629-4dc1-b33d-2ed305d911fd None admin] RBAC: Adding query filter params (role.id=70cebcd047db4003b7016de5c93cab80, scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412, user.id=045909bc53cf41cc804f18ddc4d94d3c) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:40.347154 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11121ef-d629-4dc1-b33d-2ed305d911fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:40.348943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11121ef-d629-4dc1-b33d-2ed305d911fd None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:40.356097 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 78/152] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:40 2022] GET /identity/v3/role_assignments?user.id=045909bc53cf41cc804f18ddc4d94d3c&scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412&role.id=70cebcd047db4003b7016de5c93cab80 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:40.481496 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 75/153] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:40.486876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11121ef-d629-4dc1-b33d-2ed305d911fd None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:40.607389 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:40.635485 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11121ef-d629-4dc1-b33d-2ed305d911fd None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:40.676161 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce8ff3-a3a2-43bb-9388-5a1d0d18105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:40.676795 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce8ff3-a3a2-43bb-9388-5a1d0d18105b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:40.677077 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce8ff3-a3a2-43bb-9388-5a1d0d18105b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:40.677351 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce8ff3-a3a2-43bb-9388-5a1d0d18105b None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:40.678485 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce8ff3-a3a2-43bb-9388-5a1d0d18105b None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:40.680005 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce8ff3-a3a2-43bb-9388-5a1d0d18105b None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:40.681972 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 79/154] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:40 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:40.687794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75f456-db05-4a50-9f54-40a375e234da None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:40.716401 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce8ff3-a3a2-43bb-9388-5a1d0d18105b None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:40.748094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:40.826156 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75f456-db05-4a50-9f54-40a375e234da None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:40.842266 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce8ff3-a3a2-43bb-9388-5a1d0d18105b None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:40.863824 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202640c4-4158-4337-80b2-2afa7b9b58cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:40.864363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202640c4-4158-4337-80b2-2afa7b9b58cc None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:40.864646 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202640c4-4158-4337-80b2-2afa7b9b58cc None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:40.864918 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202640c4-4158-4337-80b2-2afa7b9b58cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:40.865641 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202640c4-4158-4337-80b2-2afa7b9b58cc None admin] RBAC: Adding query filter params (role.id=49c7d15532d94cafac420a6bcf8574ad, scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412, user.id=71471eb8a3e6483ebb3f0a3b9d99aedd) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:40.866237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202640c4-4158-4337-80b2-2afa7b9b58cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:40.867708 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202640c4-4158-4337-80b2-2afa7b9b58cc None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:40.874297 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 76/155] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:40 2022] GET /identity/v3/role_assignments?user.id=71471eb8a3e6483ebb3f0a3b9d99aedd&scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412&role.id=49c7d15532d94cafac420a6bcf8574ad => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:40.875770 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba00b86-5283-44f2-907f-be31686ef6cb None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:40.876054 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba00b86-5283-44f2-907f-be31686ef6cb None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:40.876328 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba00b86-5283-44f2-907f-be31686ef6cb None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:40.881822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 77/156] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:40.881822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c8a2-9b76-4f91-b817-042487895425 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:40.881822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c8a2-9b76-4f91-b817-042487895425 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:40.881822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c8a2-9b76-4f91-b817-042487895425 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:40.881822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 78/157] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:40.887189 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e829b1-a628-4f71-a116-98f14235f571 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:40.887503 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e829b1-a628-4f71-a116-98f14235f571 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:40.887788 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e829b1-a628-4f71-a116-98f14235f571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:40.888638 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05bfc5-3ccb-478f-8470-93ec45d6e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:40.889498 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05bfc5-3ccb-478f-8470-93ec45d6e706 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:40.889953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05bfc5-3ccb-478f-8470-93ec45d6e706 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:40.890408 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05bfc5-3ccb-478f-8470-93ec45d6e706 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:40.891945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05bfc5-3ccb-478f-8470-93ec45d6e706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:40.893653 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05bfc5-3ccb-478f-8470-93ec45d6e706 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:40.895607 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 80/158] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:40.897203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680e2f-9c45-4b33-bdae-09d0642c165f None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:40.897717 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680e2f-9c45-4b33-bdae-09d0642c165f None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:40.898184 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680e2f-9c45-4b33-bdae-09d0642c165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:40.907460 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-68e829b1-a628-4f71-a116-98f14235f571 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:40.908697 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-68e829b1-a628-4f71-a116-98f14235f571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:40.919165 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-d0680e2f-9c45-4b33-bdae-09d0642c165f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:40.920794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-d0680e2f-9c45-4b33-bdae-09d0642c165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:40.933290 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:40.995678 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 79/159] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:40.996895 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e829b1-a628-4f71-a116-98f14235f571 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:41.015311 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 81/160] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:41.083161 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:41.163965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e829b1-a628-4f71-a116-98f14235f571 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:41.198633 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc6e30-e392-42ac-aca7-7a3f125a9e88 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:41.198916 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc6e30-e392-42ac-aca7-7a3f125a9e88 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:41.199192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc6e30-e392-42ac-aca7-7a3f125a9e88 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:41.200566 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 82/161] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:41.205893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2968d-3e64-42aa-869d-b8856fd05b5a None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:41.206091 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc25d2d-9b88-4919-a848-85f6b692653a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:41.206223 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2968d-3e64-42aa-869d-b8856fd05b5a None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:41.206439 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2968d-3e64-42aa-869d-b8856fd05b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:41.206703 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc25d2d-9b88-4919-a848-85f6b692653a None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:41.206989 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc25d2d-9b88-4919-a848-85f6b692653a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:41.207293 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc25d2d-9b88-4919-a848-85f6b692653a None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:41.207924 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc25d2d-9b88-4919-a848-85f6b692653a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:41.209353 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc25d2d-9b88-4919-a848-85f6b692653a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:41.234737 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 80/162] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Aug 18 21:00:40 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:00:41.245065 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-2bd2968d-3e64-42aa-869d-b8856fd05b5a None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:41.246376 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-2bd2968d-3e64-42aa-869d-b8856fd05b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:41.340983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 83/163] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:41.363504 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc25d2d-9b88-4919-a848-85f6b692653a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:41.464866 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2968d-3e64-42aa-869d-b8856fd05b5a None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:41.467800 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:41.487664 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc25d2d-9b88-4919-a848-85f6b692653a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:41.531299 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80a833-178a-4b4b-8711-22f45839fef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:41.532005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80a833-178a-4b4b-8711-22f45839fef1 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:41.532345 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80a833-178a-4b4b-8711-22f45839fef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:41.532678 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80a833-178a-4b4b-8711-22f45839fef1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:41.544308 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80a833-178a-4b4b-8711-22f45839fef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-4c80a833-178a-4b4b-8711-22f45839fef1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:41.549508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:41.550363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:41.551225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:41.551225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:41.551225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:41.551225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:41.551225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:41.551225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:41.551225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:41.551225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:41.551225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:41.551225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:41.551225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:00:41.551225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:41.551225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 81/164] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:00:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:41.557876 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80a833-178a-4b4b-8711-22f45839fef1 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:41.570952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:41.608981 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2968d-3e64-42aa-869d-b8856fd05b5a None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:41.652279 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a23d8-cfb3-485e-88d3-fc6f9e016670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:41.653718 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a23d8-cfb3-485e-88d3-fc6f9e016670 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:41.653718 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a23d8-cfb3-485e-88d3-fc6f9e016670 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:41.653718 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a23d8-cfb3-485e-88d3-fc6f9e016670 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:41.666946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a23d8-cfb3-485e-88d3-fc6f9e016670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-d22a23d8-cfb3-485e-88d3-fc6f9e016670 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:41.672456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:41.673295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:41.674069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:41.674069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:41.674069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:41.674069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:41.674069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:41.674069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:41.674069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:41.674069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:41.674069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:41.674069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:41.674069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:00:41.674069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:41.674069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 84/165] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:41.681079 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a23d8-cfb3-485e-88d3-fc6f9e016670 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:41.700142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80a833-178a-4b4b-8711-22f45839fef1 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:41.750476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad37c4-71b4-4e20-8355-bc0d51a1d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:41.751018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad37c4-71b4-4e20-8355-bc0d51a1d246 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:41.751344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad37c4-71b4-4e20-8355-bc0d51a1d246 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:41.752324 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad37c4-71b4-4e20-8355-bc0d51a1d246 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:41.752324 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad37c4-71b4-4e20-8355-bc0d51a1d246 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:41.752590 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad37c4-71b4-4e20-8355-bc0d51a1d246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:41.753956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad37c4-71b4-4e20-8355-bc0d51a1d246 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:41.763128 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 82/166] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:00:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:41.763912 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad37c4-71b4-4e20-8355-bc0d51a1d246 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:41.777345 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:41.814869 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a23d8-cfb3-485e-88d3-fc6f9e016670 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:41.859246 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d1dc2-c038-49a2-92d0-1248af3d61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:41.860311 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1dc2-c038-49a2-92d0-1248af3d61a3 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:41.860600 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1dc2-c038-49a2-92d0-1248af3d61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:41.860875 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1dc2-c038-49a2-92d0-1248af3d61a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:41.861849 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d1dc2-c038-49a2-92d0-1248af3d61a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:41.862159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d1dc2-c038-49a2-92d0-1248af3d61a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:41.863573 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d1dc2-c038-49a2-92d0-1248af3d61a3 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:41.865991 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:41.875250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 85/167] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:41.880502 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d1dc2-c038-49a2-92d0-1248af3d61a3 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:41.888340 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad37c4-71b4-4e20-8355-bc0d51a1d246 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:41.934449 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0b0eb-7f85-4a4e-92d5-f19deb0f0b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:41.935095 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b0eb-7f85-4a4e-92d5-f19deb0f0b03 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:41.935565 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b0eb-7f85-4a4e-92d5-f19deb0f0b03 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:41.935842 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b0eb-7f85-4a4e-92d5-f19deb0f0b03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:41.948407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0b0eb-7f85-4a4e-92d5-f19deb0f0b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-9ea0b0eb-7f85-4a4e-92d5-f19deb0f0b03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:41.954420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:41.955432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:41.956220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:41.956220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:41.956220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:41.956220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:41.956220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:41.956220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:41.956220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:41.956220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:41.956220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:41.956220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:41.956220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:41.956220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:41.957418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 83/168] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:41.957772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0b0eb-7f85-4a4e-92d5-f19deb0f0b03 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:42.010054 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d1dc2-c038-49a2-92d0-1248af3d61a3 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:42.036030 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:42.057871 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf344-2f7c-42db-ac3a-d8e4d2cfec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:42.058871 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf344-2f7c-42db-ac3a-d8e4d2cfec65 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:42.059381 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf344-2f7c-42db-ac3a-d8e4d2cfec65 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:42.059852 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf344-2f7c-42db-ac3a-d8e4d2cfec65 None admin] PATH_INFO: `/v3/users/045909bc53cf41cc804f18ddc4d94d3c` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:42.061419 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bf344-2f7c-42db-ac3a-d8e4d2cfec65 None admin] RBAC: Authorizing `identity:get_user(user_id=045909bc53cf41cc804f18ddc4d94d3c)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:42.063110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bf344-2f7c-42db-ac3a-d8e4d2cfec65 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:42.065891 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 86/169] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:41 2022] GET /identity/v3/users/045909bc53cf41cc804f18ddc4d94d3c => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:42.066949 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf344-2f7c-42db-ac3a-d8e4d2cfec65 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:42.081958 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0b0eb-7f85-4a4e-92d5-f19deb0f0b03 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:42.130850 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994e805-564c-46d2-ba0b-46c72c7a2e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:42.131537 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994e805-564c-46d2-ba0b-46c72c7a2e4a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:42.131822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994e805-564c-46d2-ba0b-46c72c7a2e4a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:42.132098 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994e805-564c-46d2-ba0b-46c72c7a2e4a None admin] PATH_INFO: `/v3/users/31a81cdb227b4f13a2d92360514ffa6f` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:42.133252 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994e805-564c-46d2-ba0b-46c72c7a2e4a None admin] RBAC: Authorizing `identity:get_user(user_id=31a81cdb227b4f13a2d92360514ffa6f)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:42.135286 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994e805-564c-46d2-ba0b-46c72c7a2e4a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:42.137042 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 84/170] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:41 2022] GET /identity/v3/users/31a81cdb227b4f13a2d92360514ffa6f => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:42.143159 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994e805-564c-46d2-ba0b-46c72c7a2e4a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:42.147453 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:42.193851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf344-2f7c-42db-ac3a-d8e4d2cfec65 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:42.261927 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f48bb-ba3c-4bea-a94a-dd93507a05bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:42.262866 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f48bb-ba3c-4bea-a94a-dd93507a05bc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:42.263481 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f48bb-ba3c-4bea-a94a-dd93507a05bc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:42.263953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f48bb-ba3c-4bea-a94a-dd93507a05bc None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:42.264809 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f48bb-ba3c-4bea-a94a-dd93507a05bc None admin] RBAC: Adding query filter params (name=member) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:42.265308 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f48bb-ba3c-4bea-a94a-dd93507a05bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:42.267182 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f48bb-ba3c-4bea-a94a-dd93507a05bc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:42.279214 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 87/171] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:42.280478 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f48bb-ba3c-4bea-a94a-dd93507a05bc None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:42.375330 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994e805-564c-46d2-ba0b-46c72c7a2e4a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:42.417264 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b286ce-2ee0-42fa-91f8-467ed3b6a218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:42.418323 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b286ce-2ee0-42fa-91f8-467ed3b6a218 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:42.418827 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b286ce-2ee0-42fa-91f8-467ed3b6a218 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:42.419505 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b286ce-2ee0-42fa-91f8-467ed3b6a218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:42.422563 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:42.459343 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f48bb-ba3c-4bea-a94a-dd93507a05bc None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:42.506742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b286ce-2ee0-42fa-91f8-467ed3b6a218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:42.509925 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b286ce-2ee0-42fa-91f8-467ed3b6a218 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:42.513213 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:42.538317 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e06c8-8d93-4eb4-ae51-cb0afca02c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:42.538965 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e06c8-8d93-4eb4-ae51-cb0afca02c6f None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:42.539246 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e06c8-8d93-4eb4-ae51-cb0afca02c6f None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:42.539538 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e06c8-8d93-4eb4-ae51-cb0afca02c6f None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:42.543889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e06c8-8d93-4eb4-ae51-cb0afca02c6f None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:42.545369 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e06c8-8d93-4eb4-ae51-cb0afca02c6f None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:42.556652 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 88/172] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:42 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:42.557530 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e06c8-8d93-4eb4-ae51-cb0afca02c6f None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:42.658688 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 85/173] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:42.664148 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b286ce-2ee0-42fa-91f8-467ed3b6a218 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:42.703760 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:42.779397 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b286ce-2ee0-42fa-91f8-467ed3b6a218 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:42.818524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c694900-fa24-4039-bf09-f7113af427ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:42.819182 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694900-fa24-4039-bf09-f7113af427ed None admin] REQUEST_METHOD: `PUT` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:42.819524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694900-fa24-4039-bf09-f7113af427ed None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:42.819809 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694900-fa24-4039-bf09-f7113af427ed None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412/users/31a81cdb227b4f13a2d92360514ffa6f/roles/9d0c3738e3c94c5db4b0766c5f44fb11` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:42.822050 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c694900-fa24-4039-bf09-f7113af427ed None admin] RBAC: Authorizing `identity:create_grant(project_id=aa7e7bc5516444f2be8b5dae7b0c4412, user_id=31a81cdb227b4f13a2d92360514ffa6f, role_id=9d0c3738e3c94c5db4b0766c5f44fb11)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:42.823734 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c694900-fa24-4039-bf09-f7113af427ed None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:42.849113 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 86/174] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:00:42 2022] PUT /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412/users/31a81cdb227b4f13a2d92360514ffa6f/roles/9d0c3738e3c94c5db4b0766c5f44fb11 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:00:42.851060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c694900-fa24-4039-bf09-f7113af427ed None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:42.865559 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e06c8-8d93-4eb4-ae51-cb0afca02c6f None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:42.958769 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06428962-472d-4922-b651-3d66f015c53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:42.959844 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06428962-472d-4922-b651-3d66f015c53e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:42.960345 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06428962-472d-4922-b651-3d66f015c53e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:42.960814 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06428962-472d-4922-b651-3d66f015c53e None admin] PATH_INFO: `/v3/users/045909bc53cf41cc804f18ddc4d94d3c` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:42.962854 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06428962-472d-4922-b651-3d66f015c53e None admin] RBAC: Authorizing `identity:get_user(user_id=045909bc53cf41cc804f18ddc4d94d3c)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:42.964619 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06428962-472d-4922-b651-3d66f015c53e None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:42.971312 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 89/175] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:42 2022] GET /identity/v3/users/045909bc53cf41cc804f18ddc4d94d3c => generated 275 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:42.971530 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:42.973566 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06428962-472d-4922-b651-3d66f015c53e None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:42.979884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c694900-fa24-4039-bf09-f7113af427ed None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:43.020792 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c6a00-98b3-427a-a64e-40ed042468c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:43.021431 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c6a00-98b3-427a-a64e-40ed042468c6 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:43.021713 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c6a00-98b3-427a-a64e-40ed042468c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:43.022043 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c6a00-98b3-427a-a64e-40ed042468c6 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:43.023232 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c6a00-98b3-427a-a64e-40ed042468c6 None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:43.025651 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c6a00-98b3-427a-a64e-40ed042468c6 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:43.027871 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 87/176] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:42 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:43.034031 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c6a00-98b3-427a-a64e-40ed042468c6 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:43.083419 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:43.151109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c6a00-98b3-427a-a64e-40ed042468c6 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:43.152269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06428962-472d-4922-b651-3d66f015c53e None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:43.190148 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf5779-65c3-491b-9107-b86edb9710a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:43.190765 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf5779-65c3-491b-9107-b86edb9710a8 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:43.191046 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf5779-65c3-491b-9107-b86edb9710a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:43.191349 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf5779-65c3-491b-9107-b86edb9710a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:43.192095 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf5779-65c3-491b-9107-b86edb9710a8 None admin] RBAC: Adding query filter params (role.id=5d73f21ba2e940f38026b109b9c9e10e, scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412, user.id=045909bc53cf41cc804f18ddc4d94d3c) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:43.192408 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf5779-65c3-491b-9107-b86edb9710a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:43.193899 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf5779-65c3-491b-9107-b86edb9710a8 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:43.200694 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 88/177] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:43 2022] GET /identity/v3/role_assignments?user.id=045909bc53cf41cc804f18ddc4d94d3c&scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412&role.id=5d73f21ba2e940f38026b109b9c9e10e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:43.215569 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11588915-f317-4ed8-b700-9f8df1f6b776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:43.216233 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11588915-f317-4ed8-b700-9f8df1f6b776 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:43.216526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11588915-f317-4ed8-b700-9f8df1f6b776 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:43.216899 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11588915-f317-4ed8-b700-9f8df1f6b776 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:43.299238 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11588915-f317-4ed8-b700-9f8df1f6b776 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:43.300688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11588915-f317-4ed8-b700-9f8df1f6b776 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:43.381668 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:43.429357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 90/178] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:43.434608 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf5779-65c3-491b-9107-b86edb9710a8 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:43.471221 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:43.555388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf5779-65c3-491b-9107-b86edb9710a8 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:43.594970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c4de1-41d1-43a5-99a3-a577287fc809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:43.595650 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c4de1-41d1-43a5-99a3-a577287fc809 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:43.595934 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c4de1-41d1-43a5-99a3-a577287fc809 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:43.596211 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c4de1-41d1-43a5-99a3-a577287fc809 None admin] PATH_INFO: `/v3/projects/37b8c49b089d4a4bbf2384e1e3f595aa` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:43.597446 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c4de1-41d1-43a5-99a3-a577287fc809 None admin] RBAC: Authorizing `identity:get_project(project_id=37b8c49b089d4a4bbf2384e1e3f595aa)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:43.600726 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c4de1-41d1-43a5-99a3-a577287fc809 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:43.600726 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 89/179] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:43 2022] GET /identity/v3/projects/37b8c49b089d4a4bbf2384e1e3f595aa => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:43.607907 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11588915-f317-4ed8-b700-9f8df1f6b776 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:43.734619 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11588915-f317-4ed8-b700-9f8df1f6b776 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:43.772936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555f616-2907-494b-89fd-d7d4cf60a08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:43.773548 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555f616-2907-494b-89fd-d7d4cf60a08d None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:43.773830 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555f616-2907-494b-89fd-d7d4cf60a08d None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:43.774105 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555f616-2907-494b-89fd-d7d4cf60a08d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:43.774954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555f616-2907-494b-89fd-d7d4cf60a08d None admin] RBAC: Adding query filter params (role.id=70cebcd047db4003b7016de5c93cab80, scope.project.id=37b8c49b089d4a4bbf2384e1e3f595aa, user.id=045909bc53cf41cc804f18ddc4d94d3c) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:43.775310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555f616-2907-494b-89fd-d7d4cf60a08d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:43.776887 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555f616-2907-494b-89fd-d7d4cf60a08d None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:43.783433 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 91/180] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:43 2022] GET /identity/v3/role_assignments?user.id=045909bc53cf41cc804f18ddc4d94d3c&scope.project.id=37b8c49b089d4a4bbf2384e1e3f595aa&role.id=70cebcd047db4003b7016de5c93cab80 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:44.115796 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35ef8-731c-4eec-94d5-bce96b0dc409 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:44.116186 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35ef8-731c-4eec-94d5-bce96b0dc409 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:44.116361 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35ef8-731c-4eec-94d5-bce96b0dc409 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:44.118003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 90/181] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:44.124010 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122cc52-8d05-44c4-85b2-b184554a082c None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:44.124485 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122cc52-8d05-44c4-85b2-b184554a082c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:44.124561 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122cc52-8d05-44c4-85b2-b184554a082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:44.149009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-c122cc52-8d05-44c4-85b2-b184554a082c None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:44.151073 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-c122cc52-8d05-44c4-85b2-b184554a082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:44.174994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:44.229492 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 92/182] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:44.530024 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216c3f9-8d59-4d65-9925-46aeed808af4 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:44.530518 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216c3f9-8d59-4d65-9925-46aeed808af4 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:44.530590 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216c3f9-8d59-4d65-9925-46aeed808af4 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:44.531962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 91/183] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:44.537178 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3564d9-6555-4319-9c0b-e098f46664d0 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:44.537465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3564d9-6555-4319-9c0b-e098f46664d0 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:44.537740 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3564d9-6555-4319-9c0b-e098f46664d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:44.557816 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-de3564d9-6555-4319-9c0b-e098f46664d0 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:44.559070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-de3564d9-6555-4319-9c0b-e098f46664d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:44.578450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216c3f9-8d59-4d65-9925-46aeed808af4 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:44.663692 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 93/184] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:44.706623 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:44.716587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216c3f9-8d59-4d65-9925-46aeed808af4 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:44.751690 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6bef4-36be-4a53-a076-cb367925823f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:44.752689 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6bef4-36be-4a53-a076-cb367925823f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:44.753167 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6bef4-36be-4a53-a076-cb367925823f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:44.753647 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6bef4-36be-4a53-a076-cb367925823f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:44.764868 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6bef4-36be-4a53-a076-cb367925823f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-0de6bef4-36be-4a53-a076-cb367925823f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:44.770309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:44.771173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:44.771987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:44.771987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:44.771987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:44.771987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:44.771987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:44.771987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:44.771987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:44.771987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:44.771987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:44.771987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:44.771987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:44.771987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:44.775156 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 92/185] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:00:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:44.787585 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3564d9-6555-4319-9c0b-e098f46664d0 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:44.842169 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cb966-9934-4fd1-a01b-4e34e5f8fcf8 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:44.842444 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cb966-9934-4fd1-a01b-4e34e5f8fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:44.842716 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cb966-9934-4fd1-a01b-4e34e5f8fcf8 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:44.844069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 93/186] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:00:44.848997 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a7437-d55f-496d-a800-a075251f83a5 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:44.849277 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a7437-d55f-496d-a800-a075251f83a5 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:44.849548 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a7437-d55f-496d-a800-a075251f83a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:44.869961 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-7a6a7437-d55f-496d-a800-a075251f83a5 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:44.871606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-7a6a7437-d55f-496d-a800-a075251f83a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:44.887302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:44.903580 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3564d9-6555-4319-9c0b-e098f46664d0 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:44.941065 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cea89f-6d05-4479-a98e-b72ca405355f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:44.942141 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cea89f-6d05-4479-a98e-b72ca405355f None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:44.942251 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cea89f-6d05-4479-a98e-b72ca405355f None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:44.942586 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cea89f-6d05-4479-a98e-b72ca405355f None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:44.943418 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cea89f-6d05-4479-a98e-b72ca405355f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:44.943718 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cea89f-6d05-4479-a98e-b72ca405355f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:44.945187 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cea89f-6d05-4479-a98e-b72ca405355f None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:44.948105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 94/187] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:44.954749 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 94/188] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:44.960256 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a7437-d55f-496d-a800-a075251f83a5 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:45.029177 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cea89f-6d05-4479-a98e-b72ca405355f None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:45.050837 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:45.067101 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a7437-d55f-496d-a800-a075251f83a5 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:45.103035 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2c12e-8b94-451e-93ba-fe7c140336dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:45.104162 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c12e-8b94-451e-93ba-fe7c140336dc None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:45.104730 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c12e-8b94-451e-93ba-fe7c140336dc None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:45.105194 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c12e-8b94-451e-93ba-fe7c140336dc None admin] PATH_INFO: `/v3/users/c36bcc994a0e4889b4ddf7ca6856b336` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:45.121095 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2c12e-8b94-451e-93ba-fe7c140336dc None admin] RBAC: Authorizing `identity:get_user(user_id=c36bcc994a0e4889b4ddf7ca6856b336)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:45.122874 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2c12e-8b94-451e-93ba-fe7c140336dc None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:45.129388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 95/189] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:44 2022] GET /identity/v3/users/c36bcc994a0e4889b4ddf7ca6856b336 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:45.130561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2c12e-8b94-451e-93ba-fe7c140336dc None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:45.142754 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cea89f-6d05-4479-a98e-b72ca405355f None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:45.189295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d23ca-443d-4c3d-87e1-c5db1f020498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:45.191034 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d23ca-443d-4c3d-87e1-c5db1f020498 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:45.191368 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d23ca-443d-4c3d-87e1-c5db1f020498 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:45.191647 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d23ca-443d-4c3d-87e1-c5db1f020498 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:45.203070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d23ca-443d-4c3d-87e1-c5db1f020498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-301d23ca-443d-4c3d-87e1-c5db1f020498 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:45.208231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:45.209099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:45.209915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:45.209915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:45.209915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:45.209915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:45.209915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:45.209915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:45.209915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:45.209915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:45.209915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:45.209915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:45.209915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:00:45.209915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:45.209915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 95/190] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:00:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:00:45.216162 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d23ca-443d-4c3d-87e1-c5db1f020498 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:45.227197 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:45.254416 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2c12e-8b94-451e-93ba-fe7c140336dc None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:45.291018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65f7f9-13c4-4bce-9836-037553c71e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:45.292084 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f7f9-13c4-4bce-9836-037553c71e37 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:45.292601 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f7f9-13c4-4bce-9836-037553c71e37 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:45.293071 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f7f9-13c4-4bce-9836-037553c71e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:45.305833 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:45.322121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d23ca-443d-4c3d-87e1-c5db1f020498 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:45.357712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc152ca-9c20-4e16-896d-f614c1d92131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:45.358551 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc152ca-9c20-4e16-896d-f614c1d92131 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:45.358830 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc152ca-9c20-4e16-896d-f614c1d92131 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:45.359097 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc152ca-9c20-4e16-896d-f614c1d92131 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:45.359843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc152ca-9c20-4e16-896d-f614c1d92131 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:45.360142 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc152ca-9c20-4e16-896d-f614c1d92131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:45.361501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc152ca-9c20-4e16-896d-f614c1d92131 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:45.369774 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 96/191] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:00:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:45.370560 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc152ca-9c20-4e16-896d-f614c1d92131 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:45.375856 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65f7f9-13c4-4bce-9836-037553c71e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:45.377406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65f7f9-13c4-4bce-9836-037553c71e37 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:45.446764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:45.483814 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 96/192] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:45.484474 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65f7f9-13c4-4bce-9836-037553c71e37 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:45.491999 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc152ca-9c20-4e16-896d-f614c1d92131 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:45.529334 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:45.531574 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071c783-6660-4ccc-96ff-7ef24ae80e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:45.532177 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c783-6660-4ccc-96ff-7ef24ae80e9f None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:45.532651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c783-6660-4ccc-96ff-7ef24ae80e9f None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:45.532755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c783-6660-4ccc-96ff-7ef24ae80e9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:45.533814 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071c783-6660-4ccc-96ff-7ef24ae80e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:45.535249 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071c783-6660-4ccc-96ff-7ef24ae80e9f None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:45.539370 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 97/193] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:45.539370 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071c783-6660-4ccc-96ff-7ef24ae80e9f None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:45.610635 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65f7f9-13c4-4bce-9836-037553c71e37 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:45.651983 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab673854-801a-49fb-b0b6-8619195a200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:45.652611 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673854-801a-49fb-b0b6-8619195a200a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:45.652888 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673854-801a-49fb-b0b6-8619195a200a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:45.653155 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673854-801a-49fb-b0b6-8619195a200a None admin] PATH_INFO: `/v3/users/c36bcc994a0e4889b4ddf7ca6856b336` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:45.654301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab673854-801a-49fb-b0b6-8619195a200a None admin] RBAC: Authorizing `identity:get_user(user_id=c36bcc994a0e4889b4ddf7ca6856b336)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:45.655842 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab673854-801a-49fb-b0b6-8619195a200a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:45.662229 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 97/194] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:45 2022] GET /identity/v3/users/c36bcc994a0e4889b4ddf7ca6856b336 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:45.662229 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab673854-801a-49fb-b0b6-8619195a200a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:45.669682 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071c783-6660-4ccc-96ff-7ef24ae80e9f None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:45.707204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8253b7c-3c6b-41a3-8d8e-3dbae12b2d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:45.708018 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8253b7c-3c6b-41a3-8d8e-3dbae12b2d37 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:45.708511 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8253b7c-3c6b-41a3-8d8e-3dbae12b2d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:45.708887 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8253b7c-3c6b-41a3-8d8e-3dbae12b2d37 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:45.710300 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8253b7c-3c6b-41a3-8d8e-3dbae12b2d37 None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:45.712688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8253b7c-3c6b-41a3-8d8e-3dbae12b2d37 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:45.719242 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 98/195] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:45 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:45.719242 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8253b7c-3c6b-41a3-8d8e-3dbae12b2d37 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:45.726608 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:45.768094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab673854-801a-49fb-b0b6-8619195a200a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:45.779473 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:45.805053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc434f-0aac-4f68-b773-ba2f4b0f95aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:45.806171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc434f-0aac-4f68-b773-ba2f4b0f95aa None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:45.806449 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc434f-0aac-4f68-b773-ba2f4b0f95aa None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:45.806719 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc434f-0aac-4f68-b773-ba2f4b0f95aa None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:45.807384 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc434f-0aac-4f68-b773-ba2f4b0f95aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:45.809393 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc434f-0aac-4f68-b773-ba2f4b0f95aa None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:45.825093 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8253b7c-3c6b-41a3-8d8e-3dbae12b2d37 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:45.831485 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 98/196] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Aug 18 21:00:45 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:00:45.831485 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc434f-0aac-4f68-b773-ba2f4b0f95aa None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:45.874016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c362-242d-466d-8579-3fce1715ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:45.874657 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c362-242d-466d-8579-3fce1715ab8c None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:45.874999 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c362-242d-466d-8579-3fce1715ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:45.875371 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c362-242d-466d-8579-3fce1715ab8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:45.944440 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc434f-0aac-4f68-b773-ba2f4b0f95aa None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:45.956092 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c362-242d-466d-8579-3fce1715ab8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:45.957691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c362-242d-466d-8579-3fce1715ab8c None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:45.967075 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:45.992350 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d623ca-8d82-4878-b5ef-93f097d8ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:45.993079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d623ca-8d82-4878-b5ef-93f097d8ee9e None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:45.993875 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d623ca-8d82-4878-b5ef-93f097d8ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:45.994152 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d623ca-8d82-4878-b5ef-93f097d8ee9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:45.994889 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d623ca-8d82-4878-b5ef-93f097d8ee9e None admin] RBAC: Adding query filter params (role.id=49c7d15532d94cafac420a6bcf8574ad, scope.project.id=59b28d193e75472297193587da13dcc8, user.id=c36bcc994a0e4889b4ddf7ca6856b336) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:45.995199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d623ca-8d82-4878-b5ef-93f097d8ee9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:45.996768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d623ca-8d82-4878-b5ef-93f097d8ee9e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:46.004026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 99/197] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:45 2022] GET /identity/v3/role_assignments?user.id=c36bcc994a0e4889b4ddf7ca6856b336&scope.project.id=59b28d193e75472297193587da13dcc8&role.id=49c7d15532d94cafac420a6bcf8574ad => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:46.009419 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647db07f-b924-4123-9a82-c53ef2c8c3e3 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:46.009705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647db07f-b924-4123-9a82-c53ef2c8c3e3 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:46.009978 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647db07f-b924-4123-9a82-c53ef2c8c3e3 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:46.011372 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 100/198] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:46.017178 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600173d-cd75-44c8-90af-0e8770c58c7e None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:46.017499 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600173d-cd75-44c8-90af-0e8770c58c7e None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:46.017728 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600173d-cd75-44c8-90af-0e8770c58c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:46.041681 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-3600173d-cd75-44c8-90af-0e8770c58c7e None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:46.042401 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-3600173d-cd75-44c8-90af-0e8770c58c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:46.074258 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:46.093514 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 99/199] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:46.098500 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c362-242d-466d-8579-3fce1715ab8c None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:46.135371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 101/200] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:00:46.235507 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c362-242d-466d-8579-3fce1715ab8c None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:46.244248 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:46.273901 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16708a-0223-4f73-972f-bb7b627065b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:46.275143 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16708a-0223-4f73-972f-bb7b627065b7 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:46.275465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16708a-0223-4f73-972f-bb7b627065b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:46.275740 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16708a-0223-4f73-972f-bb7b627065b7 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:46.276893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16708a-0223-4f73-972f-bb7b627065b7 None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:46.278354 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16708a-0223-4f73-972f-bb7b627065b7 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:46.280335 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 100/201] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:46 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:46.286234 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600173d-cd75-44c8-90af-0e8770c58c7e None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:46.393810 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600173d-cd75-44c8-90af-0e8770c58c7e None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:46.429895 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aef8a6-3bc5-4fd1-bba7-2dbe8c84a1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:46.430538 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aef8a6-3bc5-4fd1-bba7-2dbe8c84a1b8 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:46.430822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aef8a6-3bc5-4fd1-bba7-2dbe8c84a1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:46.431144 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aef8a6-3bc5-4fd1-bba7-2dbe8c84a1b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:46.431902 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aef8a6-3bc5-4fd1-bba7-2dbe8c84a1b8 None admin] RBAC: Adding query filter params (role.id=5d73f21ba2e940f38026b109b9c9e10e, scope.project.id=59b28d193e75472297193587da13dcc8, user.id=c36bcc994a0e4889b4ddf7ca6856b336) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:46.432214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aef8a6-3bc5-4fd1-bba7-2dbe8c84a1b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:46.433663 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aef8a6-3bc5-4fd1-bba7-2dbe8c84a1b8 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:46.439647 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 102/202] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:46 2022] GET /identity/v3/role_assignments?user.id=c36bcc994a0e4889b4ddf7ca6856b336&scope.project.id=59b28d193e75472297193587da13dcc8&role.id=5d73f21ba2e940f38026b109b9c9e10e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:46.484657 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16708a-0223-4f73-972f-bb7b627065b7 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:46.622489 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16708a-0223-4f73-972f-bb7b627065b7 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:46.676018 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea9029-527f-4947-8cb5-e43b5c5b855e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:46.676635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea9029-527f-4947-8cb5-e43b5c5b855e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:46.676916 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea9029-527f-4947-8cb5-e43b5c5b855e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:46.677187 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea9029-527f-4947-8cb5-e43b5c5b855e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:46.693903 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea9029-527f-4947-8cb5-e43b5c5b855e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-0fea9029-527f-4947-8cb5-e43b5c5b855e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:46.701002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:46.707103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:46.708840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:46.708840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:46.708840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:46.708840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:46.708840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:46.708840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:46.708840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:46.708840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:46.708840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:46.708840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:46.708840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:00:46.708840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:46.708840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 101/203] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:46.711330 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aef8a6-3bc5-4fd1-bba7-2dbe8c84a1b8 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:46.741375 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:46.834362 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aef8a6-3bc5-4fd1-bba7-2dbe8c84a1b8 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:46.872922 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e240e3-07c4-4b5f-88c5-27e08a928e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:46.873535 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e240e3-07c4-4b5f-88c5-27e08a928e4c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:46.873812 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e240e3-07c4-4b5f-88c5-27e08a928e4c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:46.874081 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e240e3-07c4-4b5f-88c5-27e08a928e4c None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:46.874799 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e240e3-07c4-4b5f-88c5-27e08a928e4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:46.875190 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e240e3-07c4-4b5f-88c5-27e08a928e4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:46.876599 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e240e3-07c4-4b5f-88c5-27e08a928e4c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:46.885787 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 103/204] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:46.891403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea9029-527f-4947-8cb5-e43b5c5b855e None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:46.929306 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:47.028598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea9029-527f-4947-8cb5-e43b5c5b855e None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:47.080415 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4a275-70a1-4e6f-96d8-3784756d949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:47.081040 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4a275-70a1-4e6f-96d8-3784756d949d None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:47.081321 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4a275-70a1-4e6f-96d8-3784756d949d None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:47.081595 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4a275-70a1-4e6f-96d8-3784756d949d None admin] PATH_INFO: `/v3/users/31a81cdb227b4f13a2d92360514ffa6f` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:47.083984 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4a275-70a1-4e6f-96d8-3784756d949d None admin] RBAC: Authorizing `identity:get_user(user_id=31a81cdb227b4f13a2d92360514ffa6f)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:47.085466 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4a275-70a1-4e6f-96d8-3784756d949d None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:47.087121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 102/205] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:46 2022] GET /identity/v3/users/31a81cdb227b4f13a2d92360514ffa6f => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:47.093183 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e240e3-07c4-4b5f-88c5-27e08a928e4c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:47.231048 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:47.255438 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e240e3-07c4-4b5f-88c5-27e08a928e4c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:47.298226 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa78b3-e0db-48e0-8e50-521813a7b0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:47.298839 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa78b3-e0db-48e0-8e50-521813a7b0bf None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:47.299116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa78b3-e0db-48e0-8e50-521813a7b0bf None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:47.299416 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa78b3-e0db-48e0-8e50-521813a7b0bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:47.398599 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa78b3-e0db-48e0-8e50-521813a7b0bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:47.400662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa78b3-e0db-48e0-8e50-521813a7b0bf None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:47.532391 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:47.551202 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 104/206] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:47.560340 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4a275-70a1-4e6f-96d8-3784756d949d None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:47.694369 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4a275-70a1-4e6f-96d8-3784756d949d None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:47.695945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:47.743791 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093216f-07c0-45d5-9a59-375d9030d031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:47.744778 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093216f-07c0-45d5-9a59-375d9030d031 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:47.745289 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093216f-07c0-45d5-9a59-375d9030d031 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:47.745758 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093216f-07c0-45d5-9a59-375d9030d031 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:47.749353 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093216f-07c0-45d5-9a59-375d9030d031 None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:47.751071 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093216f-07c0-45d5-9a59-375d9030d031 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:47.753479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 103/207] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:47 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:47.759556 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa78b3-e0db-48e0-8e50-521813a7b0bf None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:47.914230 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa78b3-e0db-48e0-8e50-521813a7b0bf None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:47.966354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3324aa-b5f9-44bb-9618-a1f92c06dc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:47.966969 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3324aa-b5f9-44bb-9618-a1f92c06dc02 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:47.967248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3324aa-b5f9-44bb-9618-a1f92c06dc02 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:47.967543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3324aa-b5f9-44bb-9618-a1f92c06dc02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:47.968266 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3324aa-b5f9-44bb-9618-a1f92c06dc02 None admin] RBAC: Adding query filter params (role.id=9d0c3738e3c94c5db4b0766c5f44fb11, scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412, user.id=31a81cdb227b4f13a2d92360514ffa6f) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:47.968578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3324aa-b5f9-44bb-9618-a1f92c06dc02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:47.970018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3324aa-b5f9-44bb-9618-a1f92c06dc02 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:47.979852 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 105/208] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:47 2022] GET /identity/v3/role_assignments?user.id=31a81cdb227b4f13a2d92360514ffa6f&scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412&role.id=9d0c3738e3c94c5db4b0766c5f44fb11 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:48.651693 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e022d6-a040-42f3-a904-6582024da678 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:48.652525 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e022d6-a040-42f3-a904-6582024da678 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:48.652956 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e022d6-a040-42f3-a904-6582024da678 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:48.654442 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 104/209] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:48.660037 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30161db3-8d45-4822-a97f-88da855b7660 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:48.660615 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30161db3-8d45-4822-a97f-88da855b7660 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:48.661128 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30161db3-8d45-4822-a97f-88da855b7660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:48.680829 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-30161db3-8d45-4822-a97f-88da855b7660 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:48.682422 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-30161db3-8d45-4822-a97f-88da855b7660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:48.737370 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:48.752739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaf692-eb8d-4dba-9363-20441ba3d3ee None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:48.753371 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaf692-eb8d-4dba-9363-20441ba3d3ee None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:48.753739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaf692-eb8d-4dba-9363-20441ba3d3ee None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:48.755253 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 105/210] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:48.760602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 106/211] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:48.761046 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d8417-512e-41fc-9f39-a549ffeee14c None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:48.761123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d8417-512e-41fc-9f39-a549ffeee14c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:48.761446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d8417-512e-41fc-9f39-a549ffeee14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:48.782235 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-661d8417-512e-41fc-9f39-a549ffeee14c None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:48.783755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-661d8417-512e-41fc-9f39-a549ffeee14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:48.858629 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 106/212] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:00:49.089049 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3306d5d-a3d3-470e-9ff1-bd1ee0642c60 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:49.089748 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3306d5d-a3d3-470e-9ff1-bd1ee0642c60 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:49.090232 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3306d5d-a3d3-470e-9ff1-bd1ee0642c60 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:49.091822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 107/213] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:49.096318 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d8417-512e-41fc-9f39-a549ffeee14c None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:49.097133 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9952af-1f22-4f3b-8cf0-36700abf05cf None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:49.097582 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9952af-1f22-4f3b-8cf0-36700abf05cf None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:49.097998 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9952af-1f22-4f3b-8cf0-36700abf05cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:49.119100 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-3c9952af-1f22-4f3b-8cf0-36700abf05cf None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:49.120522 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-3c9952af-1f22-4f3b-8cf0-36700abf05cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:49.200676 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 108/214] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:00:49.202317 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a1580-cc84-4576-a895-4ba66ac49d10 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:49.202608 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a1580-cc84-4576-a895-4ba66ac49d10 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:49.202881 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a1580-cc84-4576-a895-4ba66ac49d10 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:49.204152 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 109/215] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:49.204848 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a1580-cc84-4576-a895-4ba66ac49d10 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:49.213684 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:49.216804 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d8417-512e-41fc-9f39-a549ffeee14c None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:49.257003 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ce714-4c73-4282-aaaa-88cd5cd03a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:49.257646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ce714-4c73-4282-aaaa-88cd5cd03a37 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:49.257918 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ce714-4c73-4282-aaaa-88cd5cd03a37 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:49.258187 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ce714-4c73-4282-aaaa-88cd5cd03a37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:49.268912 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ce714-4c73-4282-aaaa-88cd5cd03a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-580ce714-4c73-4282-aaaa-88cd5cd03a37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:49.273614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:49.275111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 107/216] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:49.280817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254037c-7214-4a8c-b395-9e399b6bfa51 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:49.281516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254037c-7214-4a8c-b395-9e399b6bfa51 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:49.281516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254037c-7214-4a8c-b395-9e399b6bfa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:49.294392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-3254037c-7214-4a8c-b395-9e399b6bfa51 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:49.295615 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-3254037c-7214-4a8c-b395-9e399b6bfa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:49.323910 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a1580-cc84-4576-a895-4ba66ac49d10 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:49.335054 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:49.361579 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa05c8-8b79-4e5e-b6f7-c0b7b3bd8f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:49.362323 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa05c8-8b79-4e5e-b6f7-c0b7b3bd8f64 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:49.362604 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa05c8-8b79-4e5e-b6f7-c0b7b3bd8f64 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:49.362921 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa05c8-8b79-4e5e-b6f7-c0b7b3bd8f64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:49.365138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 108/217] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:49.374243 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa05c8-8b79-4e5e-b6f7-c0b7b3bd8f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:49.376149 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254037c-7214-4a8c-b395-9e399b6bfa51 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-1daa05c8-8b79-4e5e-b6f7-c0b7b3bd8f64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:49.379149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:49.380138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 110/218] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:49.387248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa05c8-8b79-4e5e-b6f7-c0b7b3bd8f64 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:49.483166 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:49.499179 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254037c-7214-4a8c-b395-9e399b6bfa51 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:49.528126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa05c8-8b79-4e5e-b6f7-c0b7b3bd8f64 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:49.536831 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47e135-7f03-4a1b-a132-804fe38ffd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:49.537414 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47e135-7f03-4a1b-a132-804fe38ffd99 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:49.537697 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47e135-7f03-4a1b-a132-804fe38ffd99 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:49.537967 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47e135-7f03-4a1b-a132-804fe38ffd99 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:49.538628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47e135-7f03-4a1b-a132-804fe38ffd99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:49.538934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47e135-7f03-4a1b-a132-804fe38ffd99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:49.540423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47e135-7f03-4a1b-a132-804fe38ffd99 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:49.549197 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 109/219] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:49.550140 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47e135-7f03-4a1b-a132-804fe38ffd99 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:49.567230 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d3854-1954-4824-94e0-f898c95c4128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:49.567862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d3854-1954-4824-94e0-f898c95c4128 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:49.568319 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d3854-1954-4824-94e0-f898c95c4128 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:49.568438 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d3854-1954-4824-94e0-f898c95c4128 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:49.569069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d3854-1954-4824-94e0-f898c95c4128 None admin] RBAC: Adding query filter params (name=member) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:49.569382 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d3854-1954-4824-94e0-f898c95c4128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:49.570835 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d3854-1954-4824-94e0-f898c95c4128 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:49.583385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 111/220] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:49.583385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d3854-1954-4824-94e0-f898c95c4128 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:49.619835 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:49.670655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47e135-7f03-4a1b-a132-804fe38ffd99 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:49.690039 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d3854-1954-4824-94e0-f898c95c4128 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:49.706092 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d87cb-9126-4d58-8ad6-bf510d3c85e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:49.706702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d87cb-9126-4d58-8ad6-bf510d3c85e1 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:49.706984 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d87cb-9126-4d58-8ad6-bf510d3c85e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:49.707255 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d87cb-9126-4d58-8ad6-bf510d3c85e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:49.719992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d87cb-9126-4d58-8ad6-bf510d3c85e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-118d87cb-9126-4d58-8ad6-bf510d3c85e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:49.724808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:49.725687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:49.726505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:49.726505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:49.726505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:49.726505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:49.726505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:49.726505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:49.726505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:49.726505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:49.726505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:49.726505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:49.726505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:00:49.726505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:49.726505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 110/221] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:00:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:49.728274 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d87cb-9126-4d58-8ad6-bf510d3c85e1 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:49.728468 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a409f0-7803-4e9d-afae-9c12e00c6333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:49.729026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a409f0-7803-4e9d-afae-9c12e00c6333 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:49.729401 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a409f0-7803-4e9d-afae-9c12e00c6333 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:49.729678 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a409f0-7803-4e9d-afae-9c12e00c6333 None admin] PATH_INFO: `/v3/users/c36bcc994a0e4889b4ddf7ca6856b336` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:49.730847 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a409f0-7803-4e9d-afae-9c12e00c6333 None admin] RBAC: Authorizing `identity:get_user(user_id=c36bcc994a0e4889b4ddf7ca6856b336)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:49.732331 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a409f0-7803-4e9d-afae-9c12e00c6333 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:49.733889 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 112/222] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:49 2022] GET /identity/v3/users/c36bcc994a0e4889b4ddf7ca6856b336 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:49.734648 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a409f0-7803-4e9d-afae-9c12e00c6333 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:49.745628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:49.829699 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:49.830217 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d87cb-9126-4d58-8ad6-bf510d3c85e1 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:49.832638 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a409f0-7803-4e9d-afae-9c12e00c6333 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:49.865353 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7017c5-dee3-4fd6-abae-0566062c503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:49.865977 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7017c5-dee3-4fd6-abae-0566062c503a None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:49.866101 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f23e5-d237-4bb8-b5d6-89ff72a960af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:49.866257 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7017c5-dee3-4fd6-abae-0566062c503a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:49.866533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7017c5-dee3-4fd6-abae-0566062c503a None admin] PATH_INFO: `/v3/users/8d25194609b14edcb5cc262259b5af06` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:49.866663 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f23e5-d237-4bb8-b5d6-89ff72a960af None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:49.866885 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f23e5-d237-4bb8-b5d6-89ff72a960af None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:49.867163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f23e5-d237-4bb8-b5d6-89ff72a960af None admin] PATH_INFO: `/v3/domains/default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:49.868858 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f23e5-d237-4bb8-b5d6-89ff72a960af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:49.870317 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f23e5-d237-4bb8-b5d6-89ff72a960af None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:49.871905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 113/223] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:49.872670 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f23e5-d237-4bb8-b5d6-89ff72a960af None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:49.880269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7017c5-dee3-4fd6-abae-0566062c503a None admin] RBAC: Authorizing `identity:get_user(user_id=8d25194609b14edcb5cc262259b5af06)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:49.881733 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7017c5-dee3-4fd6-abae-0566062c503a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:49.887874 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 111/224] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:49 2022] GET /identity/v3/users/8d25194609b14edcb5cc262259b5af06 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:49.887874 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7017c5-dee3-4fd6-abae-0566062c503a None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:49.952674 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:49.974426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f23e5-d237-4bb8-b5d6-89ff72a960af None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:49.982655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7017c5-dee3-4fd6-abae-0566062c503a None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:50.012810 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a937a-bc77-4009-b356-7a3a23840096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:50.013575 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a937a-bc77-4009-b356-7a3a23840096 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:50.014027 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a937a-bc77-4009-b356-7a3a23840096 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:50.014261 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a937a-bc77-4009-b356-7a3a23840096 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:50.014937 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a937a-bc77-4009-b356-7a3a23840096 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:50.015287 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a937a-bc77-4009-b356-7a3a23840096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:50.016387 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1ba7a-782d-4788-b4e6-69adacfb7310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:50.016609 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a937a-bc77-4009-b356-7a3a23840096 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:50.017013 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ba7a-782d-4788-b4e6-69adacfb7310 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:50.017294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ba7a-782d-4788-b4e6-69adacfb7310 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:50.017566 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ba7a-782d-4788-b4e6-69adacfb7310 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:50.018681 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1ba7a-782d-4788-b4e6-69adacfb7310 None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:50.020142 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1ba7a-782d-4788-b4e6-69adacfb7310 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:50.021770 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 112/225] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:49 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:50.027787 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1ba7a-782d-4788-b4e6-69adacfb7310 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:50.027887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 114/226] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:00:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:50.028207 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a937a-bc77-4009-b356-7a3a23840096 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:50.058664 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:50.124935 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1ba7a-782d-4788-b4e6-69adacfb7310 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:50.129850 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a937a-bc77-4009-b356-7a3a23840096 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:50.158328 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dea21-6c46-4d8f-900a-65b42cd17588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:50.158929 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dea21-6c46-4d8f-900a-65b42cd17588 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:50.159207 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dea21-6c46-4d8f-900a-65b42cd17588 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:50.159511 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dea21-6c46-4d8f-900a-65b42cd17588 None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:50.160144 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dea21-6c46-4d8f-900a-65b42cd17588 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:50.161581 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dea21-6c46-4d8f-900a-65b42cd17588 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:50.163140 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611dc14-6e02-43d4-b315-0013f34a0bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:50.163767 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dc14-6e02-43d4-b315-0013f34a0bcc None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:50.164042 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dc14-6e02-43d4-b315-0013f34a0bcc None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:50.164309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dc14-6e02-43d4-b315-0013f34a0bcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:50.171172 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:50.187457 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 113/227] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Aug 18 21:00:50 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:00:50.188812 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dea21-6c46-4d8f-900a-65b42cd17588 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:50.239670 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611dc14-6e02-43d4-b315-0013f34a0bcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:50.241119 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611dc14-6e02-43d4-b315-0013f34a0bcc None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:50.275878 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:50.306727 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dea21-6c46-4d8f-900a-65b42cd17588 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:50.345082 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042e34-eea6-45ec-90de-78b40dc750a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:50.345757 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042e34-eea6-45ec-90de-78b40dc750a0 None admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:50.346035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042e34-eea6-45ec-90de-78b40dc750a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:50.346303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042e34-eea6-45ec-90de-78b40dc750a0 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8/users/c36bcc994a0e4889b4ddf7ca6856b336/roles/49c7d15532d94cafac420a6bcf8574ad` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:50.348324 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5042e34-eea6-45ec-90de-78b40dc750a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=59b28d193e75472297193587da13dcc8, user_id=c36bcc994a0e4889b4ddf7ca6856b336, role_id=49c7d15532d94cafac420a6bcf8574ad)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:50.349803 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5042e34-eea6-45ec-90de-78b40dc750a0 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:50.354899 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 115/228] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:50.355817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611dc14-6e02-43d4-b315-0013f34a0bcc None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:50.369222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 114/229] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:00:50 2022] PUT /identity/v3/projects/59b28d193e75472297193587da13dcc8/users/c36bcc994a0e4889b4ddf7ca6856b336/roles/49c7d15532d94cafac420a6bcf8574ad => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:00:50.370196 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042e34-eea6-45ec-90de-78b40dc750a0 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:50.464718 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:50.520635 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611dc14-6e02-43d4-b315-0013f34a0bcc None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:50.537033 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042e34-eea6-45ec-90de-78b40dc750a0 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:50.560430 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:50.567505 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28a49e-c612-4883-902c-98bc0d87e92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:50.568313 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28a49e-c612-4883-902c-98bc0d87e92c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:50.569029 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28a49e-c612-4883-902c-98bc0d87e92c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:50.569424 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28a49e-c612-4883-902c-98bc0d87e92c None admin] PATH_INFO: `/v3/users/c36bcc994a0e4889b4ddf7ca6856b336` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:50.571225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28a49e-c612-4883-902c-98bc0d87e92c None admin] RBAC: Authorizing `identity:get_user(user_id=c36bcc994a0e4889b4ddf7ca6856b336)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:50.572981 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28a49e-c612-4883-902c-98bc0d87e92c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:50.574753 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 116/230] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:50 2022] GET /identity/v3/users/c36bcc994a0e4889b4ddf7ca6856b336 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:50.582496 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28a49e-c612-4883-902c-98bc0d87e92c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:50.585276 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b3635-db74-420d-ba5c-1224513c7893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:50.586055 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b3635-db74-420d-ba5c-1224513c7893 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:50.588368 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b3635-db74-420d-ba5c-1224513c7893 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:50.588368 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b3635-db74-420d-ba5c-1224513c7893 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:50.588718 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b3635-db74-420d-ba5c-1224513c7893 None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:50.590290 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b3635-db74-420d-ba5c-1224513c7893 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:50.592556 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 115/231] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:50 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:50.598872 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b3635-db74-420d-ba5c-1224513c7893 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:50.715917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b3635-db74-420d-ba5c-1224513c7893 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:50.735030 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28a49e-c612-4883-902c-98bc0d87e92c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:50.760057 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:50.784103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd75d3-fa2b-460a-a9be-9abcccda1e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:50.784632 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd75d3-fa2b-460a-a9be-9abcccda1e4c None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:50.784910 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd75d3-fa2b-460a-a9be-9abcccda1e4c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:50.785185 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd75d3-fa2b-460a-a9be-9abcccda1e4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:50.785919 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd75d3-fa2b-460a-a9be-9abcccda1e4c None admin] RBAC: Adding query filter params (role.id=70cebcd047db4003b7016de5c93cab80, scope.project.id=59b28d193e75472297193587da13dcc8, user.id=8d25194609b14edcb5cc262259b5af06) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:50.786238 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd75d3-fa2b-460a-a9be-9abcccda1e4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:50.787745 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd75d3-fa2b-460a-a9be-9abcccda1e4c None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:50.797371 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 116/232] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:50 2022] GET /identity/v3/role_assignments?user.id=8d25194609b14edcb5cc262259b5af06&scope.project.id=59b28d193e75472297193587da13dcc8&role.id=70cebcd047db4003b7016de5c93cab80 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:50.798926 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992a2aa-7b2a-4259-a32f-129551c13260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:50.799602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992a2aa-7b2a-4259-a32f-129551c13260 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:50.799881 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992a2aa-7b2a-4259-a32f-129551c13260 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:50.800152 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992a2aa-7b2a-4259-a32f-129551c13260 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:50.801310 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992a2aa-7b2a-4259-a32f-129551c13260 None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:50.802994 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992a2aa-7b2a-4259-a32f-129551c13260 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:50.805128 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 117/233] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:50 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:50.811632 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd75d3-fa2b-460a-a9be-9abcccda1e4c None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:50.943796 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd75d3-fa2b-460a-a9be-9abcccda1e4c None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:50.996273 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229a7ce-57b6-4660-b656-0e0359127601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:50.996968 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229a7ce-57b6-4660-b656-0e0359127601 None admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:50.997246 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229a7ce-57b6-4660-b656-0e0359127601 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:50.997518 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229a7ce-57b6-4660-b656-0e0359127601 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8/users/c36bcc994a0e4889b4ddf7ca6856b336/roles/5d73f21ba2e940f38026b109b9c9e10e` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:50.999774 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229a7ce-57b6-4660-b656-0e0359127601 None admin] RBAC: Authorizing `identity:create_grant(project_id=59b28d193e75472297193587da13dcc8, user_id=c36bcc994a0e4889b4ddf7ca6856b336, role_id=5d73f21ba2e940f38026b109b9c9e10e)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:51.001245 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229a7ce-57b6-4660-b656-0e0359127601 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:51.036681 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 117/234] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:00:50 2022] PUT /identity/v3/projects/59b28d193e75472297193587da13dcc8/users/c36bcc994a0e4889b4ddf7ca6856b336/roles/5d73f21ba2e940f38026b109b9c9e10e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:00:53.050660 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be45ebc-a87e-4d78-afd1-44512a4c6dac None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:53.051174 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be45ebc-a87e-4d78-afd1-44512a4c6dac None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:53.051248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be45ebc-a87e-4d78-afd1-44512a4c6dac None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:53.052795 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 118/235] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:53.058849 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739bbc3-1d6f-488e-9b3e-a0fd85f6a0ea None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:53.059278 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739bbc3-1d6f-488e-9b3e-a0fd85f6a0ea None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:53.059450 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739bbc3-1d6f-488e-9b3e-a0fd85f6a0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:53.088352 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-6739bbc3-1d6f-488e-9b3e-a0fd85f6a0ea None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:53.093001 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-6739bbc3-1d6f-488e-9b3e-a0fd85f6a0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:53.093264 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154a2b-ea21-4980-9def-f42099772418 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:53.093264 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154a2b-ea21-4980-9def-f42099772418 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:53.093264 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154a2b-ea21-4980-9def-f42099772418 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:53.093264 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 119/236] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:00:53.098723 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0bd0d-dd2a-42d1-b7b4-a1e79c1c7538 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:53.099228 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0bd0d-dd2a-42d1-b7b4-a1e79c1c7538 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:53.100018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0bd0d-dd2a-42d1-b7b4-a1e79c1c7538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:53.120917 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-67a0bd0d-dd2a-42d1-b7b4-a1e79c1c7538 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:53.122425 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-67a0bd0d-dd2a-42d1-b7b4-a1e79c1c7538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:53.160406 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:53.196535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 118/237] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:00:53.198324 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:53.199987 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67f88b-e110-40b4-9ad6-23ed43624bd8 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:53.200278 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67f88b-e110-40b4-9ad6-23ed43624bd8 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:53.200553 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67f88b-e110-40b4-9ad6-23ed43624bd8 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:53.202907 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 119/238] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:53.208210 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3939e6-6a76-4d1a-b585-d4b7f4a0d343 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:53.208609 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3939e6-6a76-4d1a-b585-d4b7f4a0d343 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:53.208984 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3939e6-6a76-4d1a-b585-d4b7f4a0d343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:53.215523 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 120/239] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:00:53.227363 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-2d3939e6-6a76-4d1a-b585-d4b7f4a0d343 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:53.228685 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-2d3939e6-6a76-4d1a-b585-d4b7f4a0d343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:53.296580 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 120/240] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:53.547058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0bd0d-dd2a-42d1-b7b4-a1e79c1c7538 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:53.643207 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3939e6-6a76-4d1a-b585-d4b7f4a0d343 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:53.676944 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0bd0d-dd2a-42d1-b7b4-a1e79c1c7538 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:53.731345 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86066881-7d11-4efe-a9c7-50ef5b0dc2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:53.732322 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86066881-7d11-4efe-a9c7-50ef5b0dc2d8 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:53.732806 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86066881-7d11-4efe-a9c7-50ef5b0dc2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:53.733449 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86066881-7d11-4efe-a9c7-50ef5b0dc2d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:53.735183 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86066881-7d11-4efe-a9c7-50ef5b0dc2d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:53.737359 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86066881-7d11-4efe-a9c7-50ef5b0dc2d8 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:53.740280 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 121/241] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:53.741363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86066881-7d11-4efe-a9c7-50ef5b0dc2d8 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:53.769661 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3939e6-6a76-4d1a-b585-d4b7f4a0d343 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:53.778250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:53.815719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360a4f8-7ae4-4d3b-a8ef-a2353e12eccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:53.816735 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360a4f8-7ae4-4d3b-a8ef-a2353e12eccc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:53.817223 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360a4f8-7ae4-4d3b-a8ef-a2353e12eccc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:53.817696 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360a4f8-7ae4-4d3b-a8ef-a2353e12eccc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:53.819303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:53.830098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360a4f8-7ae4-4d3b-a8ef-a2353e12eccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-2360a4f8-7ae4-4d3b-a8ef-a2353e12eccc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:53.835483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:53.836876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:53.837675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:53.837675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:53.837675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:53.837675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:53.837675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:53.837675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:53.837675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:53.837675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:53.837675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:53.837675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:53.837675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:00:53.837675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:53.840246 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 121/242] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:00:53.845773 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360a4f8-7ae4-4d3b-a8ef-a2353e12eccc None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:53.862856 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86066881-7d11-4efe-a9c7-50ef5b0dc2d8 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:53.899709 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189577-0ca4-4dab-a1a2-84941fcc71fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:53.900337 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189577-0ca4-4dab-a1a2-84941fcc71fa None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:53.900614 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189577-0ca4-4dab-a1a2-84941fcc71fa None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:53.900907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189577-0ca4-4dab-a1a2-84941fcc71fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:53.911378 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc189577-0ca4-4dab-a1a2-84941fcc71fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-bc189577-0ca4-4dab-a1a2-84941fcc71fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:53.916749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:53.917606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:53.918410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:53.918410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:53.918410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:53.918410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:53.918410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:53.918410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:53.918410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:53.918410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:53.918410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:53.918410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:53.918410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:00:53.918410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:53.918410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 122/243] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:00:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:53.919056 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189577-0ca4-4dab-a1a2-84941fcc71fa None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:53.960868 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360a4f8-7ae4-4d3b-a8ef-a2353e12eccc None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:53.996300 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f6d59-b8a1-4bd5-89c1-12881f04c372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:53.996902 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f6d59-b8a1-4bd5-89c1-12881f04c372 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:53.997175 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f6d59-b8a1-4bd5-89c1-12881f04c372 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:53.997442 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f6d59-b8a1-4bd5-89c1-12881f04c372 None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:53.998071 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f6d59-b8a1-4bd5-89c1-12881f04c372 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:53.999535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f6d59-b8a1-4bd5-89c1-12881f04c372 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:54.020403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 122/244] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Aug 18 21:00:53 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:00:54.021742 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6756a53-9e8e-4844-b4ab-447ea3df3d61 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:54.022031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6756a53-9e8e-4844-b4ab-447ea3df3d61 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:54.022309 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6756a53-9e8e-4844-b4ab-447ea3df3d61 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:54.024109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 123/245] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:54.024861 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6756a53-9e8e-4844-b4ab-447ea3df3d61 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:54.029383 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189577-0ca4-4dab-a1a2-84941fcc71fa None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:54.065086 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:54.069897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:54.083989 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8456b65-3c2b-4c75-92c9-38c59d57940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:54.084671 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456b65-3c2b-4c75-92c9-38c59d57940d None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:54.084956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456b65-3c2b-4c75-92c9-38c59d57940d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:54.085221 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456b65-3c2b-4c75-92c9-38c59d57940d None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:54.085904 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8456b65-3c2b-4c75-92c9-38c59d57940d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:54.086243 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8456b65-3c2b-4c75-92c9-38c59d57940d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:54.087754 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8456b65-3c2b-4c75-92c9-38c59d57940d None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:54.097254 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 123/246] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:54.098572 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99ca81-21d0-432c-b7c5-16f513349fd9 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:54.098861 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99ca81-21d0-432c-b7c5-16f513349fd9 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:54.099144 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99ca81-21d0-432c-b7c5-16f513349fd9 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:54.100660 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 124/247] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:54.101794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95e914-6b30-4f8f-9140-9c96ace1bcd8 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:54.102266 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95e914-6b30-4f8f-9140-9c96ace1bcd8 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:54.102560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95e914-6b30-4f8f-9140-9c96ace1bcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:54.122714 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-9c95e914-6b30-4f8f-9140-9c96ace1bcd8 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:54.124018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-9c95e914-6b30-4f8f-9140-9c96ace1bcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:54.164793 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6756a53-9e8e-4844-b4ab-447ea3df3d61 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:54.207285 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 125/248] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:54.207285 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95e914-6b30-4f8f-9140-9c96ace1bcd8 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:54.210094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70657895-ddd1-4510-8d1d-7fdcd1372ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:54.210707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70657895-ddd1-4510-8d1d-7fdcd1372ae0 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:54.211010 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70657895-ddd1-4510-8d1d-7fdcd1372ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:54.211363 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70657895-ddd1-4510-8d1d-7fdcd1372ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:54.212040 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70657895-ddd1-4510-8d1d-7fdcd1372ae0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:54.212337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70657895-ddd1-4510-8d1d-7fdcd1372ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:54.213739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70657895-ddd1-4510-8d1d-7fdcd1372ae0 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:54.223928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 124/249] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:54.225975 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03a14a-fef5-4bd3-a046-85f60a09ca95 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:54.226256 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03a14a-fef5-4bd3-a046-85f60a09ca95 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:54.227163 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03a14a-fef5-4bd3-a046-85f60a09ca95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:54.251177 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-7e03a14a-fef5-4bd3-a046-85f60a09ca95 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:54.252412 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-7e03a14a-fef5-4bd3-a046-85f60a09ca95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:54.339076 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 125/250] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:54.340047 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03a14a-fef5-4bd3-a046-85f60a09ca95 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:54.349681 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95e914-6b30-4f8f-9140-9c96ace1bcd8 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:54.357609 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:54.371231 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:54.394302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace30d9-8df9-4dd9-8cd4-bdc03553a245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:54.394709 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace30d9-8df9-4dd9-8cd4-bdc03553a245 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:54.395064 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace30d9-8df9-4dd9-8cd4-bdc03553a245 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:54.395450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace30d9-8df9-4dd9-8cd4-bdc03553a245 None admin] PATH_INFO: `/v3/users/ce6873f01a8e4a83bfd9af12a568e7d6` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:54.411903 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace30d9-8df9-4dd9-8cd4-bdc03553a245 None admin] RBAC: Authorizing `identity:get_user(user_id=ce6873f01a8e4a83bfd9af12a568e7d6)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:54.413463 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace30d9-8df9-4dd9-8cd4-bdc03553a245 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:54.416376 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 126/251] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:54 2022] GET /identity/v3/users/ce6873f01a8e4a83bfd9af12a568e7d6 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:54.422664 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace30d9-8df9-4dd9-8cd4-bdc03553a245 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:54.474317 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03a14a-fef5-4bd3-a046-85f60a09ca95 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:54.515672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8430f9-abdf-47be-815d-eb418123c4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:54.516398 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8430f9-abdf-47be-815d-eb418123c4c0 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:54.516753 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8430f9-abdf-47be-815d-eb418123c4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:54.517104 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8430f9-abdf-47be-815d-eb418123c4c0 None admin] PATH_INFO: `/v3/users/c36bcc994a0e4889b4ddf7ca6856b336` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:54.518307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8430f9-abdf-47be-815d-eb418123c4c0 None admin] RBAC: Authorizing `identity:get_user(user_id=c36bcc994a0e4889b4ddf7ca6856b336)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:54.520063 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8430f9-abdf-47be-815d-eb418123c4c0 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:54.522047 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 126/252] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:54 2022] GET /identity/v3/users/c36bcc994a0e4889b4ddf7ca6856b336 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:54.529565 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8430f9-abdf-47be-815d-eb418123c4c0 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:54.539437 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace30d9-8df9-4dd9-8cd4-bdc03553a245 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:54.578454 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d2362-0fa0-4976-a01c-7673caf5808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:54.579481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d2362-0fa0-4976-a01c-7673caf5808d None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:54.579966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d2362-0fa0-4976-a01c-7673caf5808d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:54.580438 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d2362-0fa0-4976-a01c-7673caf5808d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:54.627447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:54.645473 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:54.656542 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d2362-0fa0-4976-a01c-7673caf5808d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:54.657443 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8430f9-abdf-47be-815d-eb418123c4c0 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:54.658560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d2362-0fa0-4976-a01c-7673caf5808d None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:54.695064 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29340cf9-6c97-409a-bb6e-9d57ee08c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:54.695064 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29340cf9-6c97-409a-bb6e-9d57ee08c9ec None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:54.695408 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29340cf9-6c97-409a-bb6e-9d57ee08c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:54.695653 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29340cf9-6c97-409a-bb6e-9d57ee08c9ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:54.768198 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 127/253] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 21:00:54.769335 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d2362-0fa0-4976-a01c-7673caf5808d None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:54.829602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29340cf9-6c97-409a-bb6e-9d57ee08c9ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:54.831078 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29340cf9-6c97-409a-bb6e-9d57ee08c9ec None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:54.865725 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:54.894334 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d2362-0fa0-4976-a01c-7673caf5808d None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:54.919790 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:54.934743 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad0dff-f8a1-4efd-a209-95edaed0f540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:54.935776 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad0dff-f8a1-4efd-a209-95edaed0f540 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:54.936265 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad0dff-f8a1-4efd-a209-95edaed0f540 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:54.936734 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad0dff-f8a1-4efd-a209-95edaed0f540 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:54.940557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 127/254] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:54.941402 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29340cf9-6c97-409a-bb6e-9d57ee08c9ec None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:54.948252 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad0dff-f8a1-4efd-a209-95edaed0f540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-77ad0dff-f8a1-4efd-a209-95edaed0f540 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:54.953333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:54.954196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:54.955443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:54.955443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:54.955443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:54.955443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:54.955443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:54.955443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:54.955443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:54.955443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:54.955443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:54.955443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:54.955443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:54.955443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:54.955443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 128/255] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:54.956117 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad0dff-f8a1-4efd-a209-95edaed0f540 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:55.055424 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29340cf9-6c97-409a-bb6e-9d57ee08c9ec None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:55.066097 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad0dff-f8a1-4efd-a209-95edaed0f540 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:55.093694 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba818c27-f736-4445-ba1f-605e18f6f36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:55.094585 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba818c27-f736-4445-ba1f-605e18f6f36b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:55.094864 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba818c27-f736-4445-ba1f-605e18f6f36b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:55.095133 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba818c27-f736-4445-ba1f-605e18f6f36b None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:55.096922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba818c27-f736-4445-ba1f-605e18f6f36b None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:55.098718 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba818c27-f736-4445-ba1f-605e18f6f36b None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:55.100742 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 128/256] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:54 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:55.102035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba818c27-f736-4445-ba1f-605e18f6f36b None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:55.106514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113fe7e-b728-416c-8c1b-9a8a1f071aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:55.107177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113fe7e-b728-416c-8c1b-9a8a1f071aac None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:55.107453 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113fe7e-b728-416c-8c1b-9a8a1f071aac None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:55.107723 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113fe7e-b728-416c-8c1b-9a8a1f071aac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:55.110277 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:55.121275 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113fe7e-b728-416c-8c1b-9a8a1f071aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-6113fe7e-b728-416c-8c1b-9a8a1f071aac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:55.126501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:55.127412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 129/257] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:00:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:55.129171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113fe7e-b728-416c-8c1b-9a8a1f071aac None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:55.174959 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:55.238005 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba818c27-f736-4445-ba1f-605e18f6f36b None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:55.243498 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113fe7e-b728-416c-8c1b-9a8a1f071aac None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:55.273303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4112f-b6b9-40b2-b323-0d2fe415b0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:55.274450 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4112f-b6b9-40b2-b323-0d2fe415b0bc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:55.274906 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4112f-b6b9-40b2-b323-0d2fe415b0bc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:55.275018 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4112f-b6b9-40b2-b323-0d2fe415b0bc None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:55.276146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4112f-b6b9-40b2-b323-0d2fe415b0bc None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:55.277602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4112f-b6b9-40b2-b323-0d2fe415b0bc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:55.279556 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 129/258] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:55 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:55.280424 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4112f-b6b9-40b2-b323-0d2fe415b0bc None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:55.290685 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121d7f8-9c2c-4163-b5a3-ca299979fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:55.291286 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121d7f8-9c2c-4163-b5a3-ca299979fc7c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:55.291592 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121d7f8-9c2c-4163-b5a3-ca299979fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:55.291867 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121d7f8-9c2c-4163-b5a3-ca299979fc7c None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:55.292532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121d7f8-9c2c-4163-b5a3-ca299979fc7c None admin] RBAC: Adding query filter params (name=member) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:55.292831 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121d7f8-9c2c-4163-b5a3-ca299979fc7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:55.294212 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121d7f8-9c2c-4163-b5a3-ca299979fc7c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:55.302521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 130/259] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:55.303454 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121d7f8-9c2c-4163-b5a3-ca299979fc7c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:55.370590 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:55.391757 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4112f-b6b9-40b2-b323-0d2fe415b0bc None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:55.410068 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:55.428850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca5b00-04cf-4799-ad86-6079a7d3e0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:55.430356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca5b00-04cf-4799-ad86-6079a7d3e0b6 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:55.430830 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca5b00-04cf-4799-ad86-6079a7d3e0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:55.431367 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca5b00-04cf-4799-ad86-6079a7d3e0b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:55.431948 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121d7f8-9c2c-4163-b5a3-ca299979fc7c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:55.432519 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca5b00-04cf-4799-ad86-6079a7d3e0b6 None admin] RBAC: Adding query filter params (role.id=9d0c3738e3c94c5db4b0766c5f44fb11, scope.project.id=59b28d193e75472297193587da13dcc8, user.id=ce6873f01a8e4a83bfd9af12a568e7d6) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:55.433016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca5b00-04cf-4799-ad86-6079a7d3e0b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:55.434716 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca5b00-04cf-4799-ad86-6079a7d3e0b6 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:55.440978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 130/260] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:55 2022] GET /identity/v3/role_assignments?user.id=ce6873f01a8e4a83bfd9af12a568e7d6&scope.project.id=59b28d193e75472297193587da13dcc8&role.id=9d0c3738e3c94c5db4b0766c5f44fb11 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:55.442007 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca5b00-04cf-4799-ad86-6079a7d3e0b6 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:55.502041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b3bc0-5df8-4e40-b701-c85629439962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:55.503072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b3bc0-5df8-4e40-b701-c85629439962 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:55.503567 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b3bc0-5df8-4e40-b701-c85629439962 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:55.504032 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b3bc0-5df8-4e40-b701-c85629439962 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:55.504960 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b3bc0-5df8-4e40-b701-c85629439962 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:55.505460 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b3bc0-5df8-4e40-b701-c85629439962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:55.507383 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b3bc0-5df8-4e40-b701-c85629439962 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:55.527433 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 131/261] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:00:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:55.528321 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b3bc0-5df8-4e40-b701-c85629439962 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:55.650246 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b3bc0-5df8-4e40-b701-c85629439962 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:55.673791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:55.692459 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dddd0-01f1-4e48-9c8f-cc9e9b12b0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:55.693058 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca5b00-04cf-4799-ad86-6079a7d3e0b6 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:55.693170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dddd0-01f1-4e48-9c8f-cc9e9b12b0c6 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:55.693386 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dddd0-01f1-4e48-9c8f-cc9e9b12b0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:55.693665 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dddd0-01f1-4e48-9c8f-cc9e9b12b0c6 None admin] PATH_INFO: `/v3/users/8d25194609b14edcb5cc262259b5af06` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:55.695160 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dddd0-01f1-4e48-9c8f-cc9e9b12b0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=8d25194609b14edcb5cc262259b5af06)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:55.696679 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dddd0-01f1-4e48-9c8f-cc9e9b12b0c6 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:55.698611 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 132/262] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:55 2022] GET /identity/v3/users/8d25194609b14edcb5cc262259b5af06 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:55.699447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dddd0-01f1-4e48-9c8f-cc9e9b12b0c6 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:55.755183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077af69-6797-4e64-a43d-adb92f9be677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:55.757196 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077af69-6797-4e64-a43d-adb92f9be677 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:55.757573 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077af69-6797-4e64-a43d-adb92f9be677 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:55.757573 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077af69-6797-4e64-a43d-adb92f9be677 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:55.758939 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077af69-6797-4e64-a43d-adb92f9be677 None admin] RBAC: Adding query filter params (role.id=49c7d15532d94cafac420a6bcf8574ad, scope.project.id=59b28d193e75472297193587da13dcc8, user.id=c36bcc994a0e4889b4ddf7ca6856b336) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:55.759310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077af69-6797-4e64-a43d-adb92f9be677 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:55.764425 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077af69-6797-4e64-a43d-adb92f9be677 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:55.776181 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 131/263] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:55 2022] GET /identity/v3/role_assignments?user.id=c36bcc994a0e4889b4ddf7ca6856b336&scope.project.id=59b28d193e75472297193587da13dcc8&role.id=49c7d15532d94cafac420a6bcf8574ad => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:55.777860 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077af69-6797-4e64-a43d-adb92f9be677 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:55.886962 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:55.938008 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dddd0-01f1-4e48-9c8f-cc9e9b12b0c6 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:56.014168 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077af69-6797-4e64-a43d-adb92f9be677 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:56.021047 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20884f8a-b136-43fe-9e9a-eae379dbc1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:56.021968 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20884f8a-b136-43fe-9e9a-eae379dbc1c1 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:56.022464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20884f8a-b136-43fe-9e9a-eae379dbc1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:56.022939 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20884f8a-b136-43fe-9e9a-eae379dbc1c1 None admin] PATH_INFO: `/v3/users/c36bcc994a0e4889b4ddf7ca6856b336` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:56.027987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20884f8a-b136-43fe-9e9a-eae379dbc1c1 None admin] RBAC: Authorizing `identity:get_user(user_id=c36bcc994a0e4889b4ddf7ca6856b336)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:56.029592 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20884f8a-b136-43fe-9e9a-eae379dbc1c1 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:56.042295 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 133/264] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:55 2022] GET /identity/v3/users/c36bcc994a0e4889b4ddf7ca6856b336 => generated 283 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:56.053297 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20884f8a-b136-43fe-9e9a-eae379dbc1c1 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:56.082270 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d1ffb-d949-4bd5-b72c-32a589da52bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:56.083140 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d1ffb-d949-4bd5-b72c-32a589da52bc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:56.083578 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d1ffb-d949-4bd5-b72c-32a589da52bc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:56.084012 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d1ffb-d949-4bd5-b72c-32a589da52bc None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:56.088812 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d1ffb-d949-4bd5-b72c-32a589da52bc None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:56.090282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d1ffb-d949-4bd5-b72c-32a589da52bc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:56.095457 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 132/265] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:55 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:56.103393 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d1ffb-d949-4bd5-b72c-32a589da52bc None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:56.134851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:56.184491 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20884f8a-b136-43fe-9e9a-eae379dbc1c1 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:56.219339 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11037756-6bd7-4ae3-a403-02adf2de8387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:56.219865 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037756-6bd7-4ae3-a403-02adf2de8387 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:56.220141 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037756-6bd7-4ae3-a403-02adf2de8387 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:56.220410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037756-6bd7-4ae3-a403-02adf2de8387 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:56.235634 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d1ffb-d949-4bd5-b72c-32a589da52bc None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:56.251871 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:56.284009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f0583-bef1-42e0-8da3-00b8a7e6cc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:56.284688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f0583-bef1-42e0-8da3-00b8a7e6cc8c None admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:56.284977 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f0583-bef1-42e0-8da3-00b8a7e6cc8c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:56.285266 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f0583-bef1-42e0-8da3-00b8a7e6cc8c None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8/users/8d25194609b14edcb5cc262259b5af06/roles/70cebcd047db4003b7016de5c93cab80` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:56.292072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f0583-bef1-42e0-8da3-00b8a7e6cc8c None admin] RBAC: Authorizing `identity:create_grant(project_id=59b28d193e75472297193587da13dcc8, user_id=8d25194609b14edcb5cc262259b5af06, role_id=70cebcd047db4003b7016de5c93cab80)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:56.293552 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f0583-bef1-42e0-8da3-00b8a7e6cc8c None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:56.329493 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 133/266] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:00:56 2022] PUT /identity/v3/projects/59b28d193e75472297193587da13dcc8/users/8d25194609b14edcb5cc262259b5af06/roles/70cebcd047db4003b7016de5c93cab80 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:00:56.333031 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11037756-6bd7-4ae3-a403-02adf2de8387 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:56.334518 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11037756-6bd7-4ae3-a403-02adf2de8387 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:56.413047 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:56.474508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 134/267] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:00:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 21:00:56.480856 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f0583-bef1-42e0-8da3-00b8a7e6cc8c None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:56.668649 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f0583-bef1-42e0-8da3-00b8a7e6cc8c None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:56.717940 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a476d-de23-45d3-8690-559e249062e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:56.718573 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a476d-de23-45d3-8690-559e249062e8 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:56.718849 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a476d-de23-45d3-8690-559e249062e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:56.719116 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a476d-de23-45d3-8690-559e249062e8 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:56.720301 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a476d-de23-45d3-8690-559e249062e8 None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:56.721703 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a476d-de23-45d3-8690-559e249062e8 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:56.727463 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 134/268] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:56 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:56.731398 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11037756-6bd7-4ae3-a403-02adf2de8387 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:56.866120 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11037756-6bd7-4ae3-a403-02adf2de8387 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:56.921037 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b7ad5-d38f-4b58-a146-ab67f1e189a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:56.922034 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7ad5-d38f-4b58-a146-ab67f1e189a5 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:56.922515 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7ad5-d38f-4b58-a146-ab67f1e189a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:56.922993 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7ad5-d38f-4b58-a146-ab67f1e189a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:56.923937 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b7ad5-d38f-4b58-a146-ab67f1e189a5 None admin] RBAC: Adding query filter params (role.id=5d73f21ba2e940f38026b109b9c9e10e, scope.project.id=59b28d193e75472297193587da13dcc8, user.id=c36bcc994a0e4889b4ddf7ca6856b336) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:56.924462 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b7ad5-d38f-4b58-a146-ab67f1e189a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:56.926126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b7ad5-d38f-4b58-a146-ab67f1e189a5 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:56.926861 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f157d4d-0dbe-4f38-885e-81d0a6c1aadd None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:56.927147 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f157d4d-0dbe-4f38-885e-81d0a6c1aadd None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:56.927478 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f157d4d-0dbe-4f38-885e-81d0a6c1aadd None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:56.931285 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 135/269] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:56.934186 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1a902-de59-4682-bc23-a8a77b78223d None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:56.934472 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1a902-de59-4682-bc23-a8a77b78223d None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:56.934840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1a902-de59-4682-bc23-a8a77b78223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:56.936863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 135/270] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:00:56 2022] GET /identity/v3/role_assignments?user.id=c36bcc994a0e4889b4ddf7ca6856b336&scope.project.id=59b28d193e75472297193587da13dcc8&role.id=5d73f21ba2e940f38026b109b9c9e10e => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:56.962932 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-5fb1a902-de59-4682-bc23-a8a77b78223d None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:56.964189 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-5fb1a902-de59-4682-bc23-a8a77b78223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:57.006566 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:57.067977 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 136/271] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:00:57.173337 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6f899-6637-4356-b6e6-2e44f20cdef0 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:57.174277 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6f899-6637-4356-b6e6-2e44f20cdef0 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:57.174779 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6f899-6637-4356-b6e6-2e44f20cdef0 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:57.176363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 136/272] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:57.182549 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f26adc-226c-4025-86c5-594adec14c1f None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:57.182972 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f26adc-226c-4025-86c5-594adec14c1f None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:57.183145 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f26adc-226c-4025-86c5-594adec14c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:57.202916 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-04f26adc-226c-4025-86c5-594adec14c1f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:57.204121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-04f26adc-226c-4025-86c5-594adec14c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:57.282343 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 137/273] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:57.468108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6f899-6637-4356-b6e6-2e44f20cdef0 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:57.488222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:57.581973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6f899-6637-4356-b6e6-2e44f20cdef0 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:57.623670 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e1a3-68b1-4ac7-a844-c291758deddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:57.624301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e1a3-68b1-4ac7-a844-c291758deddc None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:57.624585 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e1a3-68b1-4ac7-a844-c291758deddc None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:57.624858 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e1a3-68b1-4ac7-a844-c291758deddc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:57.630920 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f26adc-226c-4025-86c5-594adec14c1f None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:57.639333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7e1a3-68b1-4ac7-a844-c291758deddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-76f7e1a3-68b1-4ac7-a844-c291758deddc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:57.641705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:57.642586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:57.643731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:57.643731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:57.643731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:57.643731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:57.643731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:57.643731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:57.643731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:57.643731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:57.643731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:57.643731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:57.643731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:57.643731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:00:57.643731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 137/274] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:57.648978 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e1a3-68b1-4ac7-a844-c291758deddc None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:57.750464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:57.764203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f26adc-226c-4025-86c5-594adec14c1f None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:57.766096 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:57.778121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e1a3-68b1-4ac7-a844-c291758deddc None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:57.810181 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e823c-6eb6-43c0-9483-07632ba264f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:57.811237 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e823c-6eb6-43c0-9483-07632ba264f3 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:57.811575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e823c-6eb6-43c0-9483-07632ba264f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:57.811851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e823c-6eb6-43c0-9483-07632ba264f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:57.813239 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e823c-6eb6-43c0-9483-07632ba264f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:57.815393 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e823c-6eb6-43c0-9483-07632ba264f3 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:57.817879 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 138/275] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:00:57.822801 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e823c-6eb6-43c0-9483-07632ba264f3 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:57.828638 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7983ae8-7ee7-4309-8026-e291759b70fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:57.829510 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7983ae8-7ee7-4309-8026-e291759b70fc None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:57.829981 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7983ae8-7ee7-4309-8026-e291759b70fc None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:57.830460 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7983ae8-7ee7-4309-8026-e291759b70fc None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:57.831340 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7983ae8-7ee7-4309-8026-e291759b70fc None admin] RBAC: Adding query filter params (name=member) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:57.832403 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7983ae8-7ee7-4309-8026-e291759b70fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:57.834432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7983ae8-7ee7-4309-8026-e291759b70fc None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:57.851852 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 138/276] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:57.853018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7983ae8-7ee7-4309-8026-e291759b70fc None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:57.951441 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e823c-6eb6-43c0-9483-07632ba264f3 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:57.982457 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7983ae8-7ee7-4309-8026-e291759b70fc None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:57.991419 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13676751-2283-4137-bea8-5f8a3338994b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:57.992796 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13676751-2283-4137-bea8-5f8a3338994b None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:57.993253 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13676751-2283-4137-bea8-5f8a3338994b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:57.993704 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13676751-2283-4137-bea8-5f8a3338994b None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:57.994979 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13676751-2283-4137-bea8-5f8a3338994b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:57.997339 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13676751-2283-4137-bea8-5f8a3338994b None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:58.025211 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881b113-67c3-4ced-b82d-c3267b8d11ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:58.025211 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881b113-67c3-4ced-b82d-c3267b8d11ae None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:58.025503 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881b113-67c3-4ced-b82d-c3267b8d11ae None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:58.025570 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881b113-67c3-4ced-b82d-c3267b8d11ae None admin] PATH_INFO: `/v3/users/4c8b0ad662d04ebf9a4c93851a7ea99c` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:58.031127 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 139/277] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Aug 18 21:00:57 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:00:58.043741 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:58.048209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881b113-67c3-4ced-b82d-c3267b8d11ae None admin] RBAC: Authorizing `identity:get_user(user_id=4c8b0ad662d04ebf9a4c93851a7ea99c)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:58.049978 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881b113-67c3-4ced-b82d-c3267b8d11ae None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:58.052164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 139/278] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:57 2022] GET /identity/v3/users/4c8b0ad662d04ebf9a4c93851a7ea99c => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:58.059056 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13676751-2283-4137-bea8-5f8a3338994b None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:58.092473 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:58.127602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd540c-346a-4b19-9dab-e60fbb4ed1e7 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:58.127879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd540c-346a-4b19-9dab-e60fbb4ed1e7 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:58.128298 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd540c-346a-4b19-9dab-e60fbb4ed1e7 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:58.130181 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 140/279] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:58.137377 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb01fc0-348e-4d49-a45a-67089a49bef4 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:58.137666 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb01fc0-348e-4d49-a45a-67089a49bef4 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:58.138365 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb01fc0-348e-4d49-a45a-67089a49bef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:58.162500 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-ddb01fc0-348e-4d49-a45a-67089a49bef4 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:58.165098 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-ddb01fc0-348e-4d49-a45a-67089a49bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:58.182383 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13676751-2283-4137-bea8-5f8a3338994b None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:58.222076 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da1abd-89e5-4e67-961c-526e7a1360d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:58.222834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1abd-89e5-4e67-961c-526e7a1360d6 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:58.223065 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1abd-89e5-4e67-961c-526e7a1360d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:58.223389 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1abd-89e5-4e67-961c-526e7a1360d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:58.224120 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da1abd-89e5-4e67-961c-526e7a1360d6 None admin] RBAC: Adding query filter params (role.id=70cebcd047db4003b7016de5c93cab80, user.id=4c8b0ad662d04ebf9a4c93851a7ea99c, scope.system=all) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:58.224430 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da1abd-89e5-4e67-961c-526e7a1360d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:58.226094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da1abd-89e5-4e67-961c-526e7a1360d6 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:58.234912 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 140/280] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Aug 18 21:00:58 2022] GET /identity/v3/role_assignments?user.id=4c8b0ad662d04ebf9a4c93851a7ea99c&scope.system=all&role.id=70cebcd047db4003b7016de5c93cab80 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:58.258848 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 141/281] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:58.595910 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da1abd-89e5-4e67-961c-526e7a1360d6 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:58.720248 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:58.729988 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da1abd-89e5-4e67-961c-526e7a1360d6 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:58.776712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef68d7-2ec1-4e30-8afc-78cc12895d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:58.777349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef68d7-2ec1-4e30-8afc-78cc12895d21 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:58.777623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef68d7-2ec1-4e30-8afc-78cc12895d21 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:58.777896 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef68d7-2ec1-4e30-8afc-78cc12895d21 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:58.792948 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef68d7-2ec1-4e30-8afc-78cc12895d21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-c5ef68d7-2ec1-4e30-8afc-78cc12895d21 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:58.798072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:58.798934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:58.800153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:58.800153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:58.800153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:58.800153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:58.800153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:58.800153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:58.800153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:58.800153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:58.800153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:58.800153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:58.800153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:00:58.800153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:58.800153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 141/282] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:58.807529 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb01fc0-348e-4d49-a45a-67089a49bef4 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:58.957271 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb01fc0-348e-4d49-a45a-67089a49bef4 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:58.992386 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:59.001970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c1c35-06f4-4ed2-8efa-e1cd428cf8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:59.002860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c1c35-06f4-4ed2-8efa-e1cd428cf8eb None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:59.003390 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c1c35-06f4-4ed2-8efa-e1cd428cf8eb None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:59.003855 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c1c35-06f4-4ed2-8efa-e1cd428cf8eb None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:59.004721 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c1c35-06f4-4ed2-8efa-e1cd428cf8eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:00:59.005275 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c1c35-06f4-4ed2-8efa-e1cd428cf8eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:59.006960 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c1c35-06f4-4ed2-8efa-e1cd428cf8eb None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:59.019677 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 142/283] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:59.026196 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef68d7-2ec1-4e30-8afc-78cc12895d21 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:59.077599 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654346e-a8d1-4cee-a15c-5125f8a1b36a None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:59.078485 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654346e-a8d1-4cee-a15c-5125f8a1b36a None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:59.079171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654346e-a8d1-4cee-a15c-5125f8a1b36a None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:59.082366 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 143/284] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:00:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:00:59.088081 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25dc9-ba20-4315-87e9-edd1ef42f15c None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:59.088691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25dc9-ba20-4315-87e9-edd1ef42f15c None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:59.089442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25dc9-ba20-4315-87e9-edd1ef42f15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:59.124395 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-2ed25dc9-ba20-4315-87e9-edd1ef42f15c None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:59.126124 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-2ed25dc9-ba20-4315-87e9-edd1ef42f15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:59.159498 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef68d7-2ec1-4e30-8afc-78cc12895d21 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:59.203933 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b3a57-43ac-4246-b9a9-170dae1559e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:59.204559 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b3a57-43ac-4246-b9a9-170dae1559e5 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:59.204835 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b3a57-43ac-4246-b9a9-170dae1559e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:59.205107 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b3a57-43ac-4246-b9a9-170dae1559e5 None admin] PATH_INFO: `/v3/users/ce6873f01a8e4a83bfd9af12a568e7d6` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:59.206929 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b3a57-43ac-4246-b9a9-170dae1559e5 None admin] RBAC: Authorizing `identity:get_user(user_id=ce6873f01a8e4a83bfd9af12a568e7d6)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:59.208514 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b3a57-43ac-4246-b9a9-170dae1559e5 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:59.215305 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 142/285] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:00:59 2022] GET /identity/v3/users/ce6873f01a8e4a83bfd9af12a568e7d6 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:59.224262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b3a57-43ac-4246-b9a9-170dae1559e5 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:59.256904 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 144/286] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:00:59.266613 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:59.384126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b3a57-43ac-4246-b9a9-170dae1559e5 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:59.433594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8a8a-0e37-4467-a970-f12f2b9f333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:59.434580 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8a8a-0e37-4467-a970-f12f2b9f333c None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:59.435077 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8a8a-0e37-4467-a970-f12f2b9f333c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:59.435588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8a8a-0e37-4467-a970-f12f2b9f333c None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:59.436924 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb8a8a-0e37-4467-a970-f12f2b9f333c None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:59.438551 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb8a8a-0e37-4467-a970-f12f2b9f333c None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:59.440759 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 143/287] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:00:59 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:00:59.446981 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed25dc9-ba20-4315-87e9-edd1ef42f15c None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:59.591030 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed25dc9-ba20-4315-87e9-edd1ef42f15c None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:59.621425 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:59.625467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8a8a-0e37-4467-a970-f12f2b9f333c None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:59.649500 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6aa8e7-72f1-4139-af80-5a012dfdd1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:59.650170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6aa8e7-72f1-4139-af80-5a012dfdd1a4 None admin] REQUEST_METHOD: `PUT` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:59.650456 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6aa8e7-72f1-4139-af80-5a012dfdd1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:59.650729 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6aa8e7-72f1-4139-af80-5a012dfdd1a4 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8/users/ce6873f01a8e4a83bfd9af12a568e7d6/roles/9d0c3738e3c94c5db4b0766c5f44fb11` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:59.652686 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6aa8e7-72f1-4139-af80-5a012dfdd1a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=59b28d193e75472297193587da13dcc8, user_id=ce6873f01a8e4a83bfd9af12a568e7d6, role_id=9d0c3738e3c94c5db4b0766c5f44fb11)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:59.654135 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6aa8e7-72f1-4139-af80-5a012dfdd1a4 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:59.691286 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 145/288] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:00:59 2022] PUT /identity/v3/projects/59b28d193e75472297193587da13dcc8/users/ce6873f01a8e4a83bfd9af12a568e7d6/roles/9d0c3738e3c94c5db4b0766c5f44fb11 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:00:59.748299 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:59.777704 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8a8a-0e37-4467-a970-f12f2b9f333c None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:59.825103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7235ec4-bff1-4101-a8e9-7175f0ac4006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:59.826394 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7235ec4-bff1-4101-a8e9-7175f0ac4006 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:59.826874 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7235ec4-bff1-4101-a8e9-7175f0ac4006 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:59.827464 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7235ec4-bff1-4101-a8e9-7175f0ac4006 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:59.844751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7235ec4-bff1-4101-a8e9-7175f0ac4006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-e7235ec4-bff1-4101-a8e9-7175f0ac4006 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:00:59.850739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:00:59.851762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:00:59.852557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:00:59.852557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:00:59.852557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:00:59.852557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:00:59.852557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:00:59.852557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:00:59.852557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:00:59.852557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:00:59.852557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:00:59.852557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:00:59.852557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:00:59.852557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:00:59.859889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 144/289] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:00:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:00:59.864471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6aa8e7-72f1-4139-af80-5a012dfdd1a4 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:00.011128 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6aa8e7-72f1-4139-af80-5a012dfdd1a4 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:00.050136 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291d644-ea05-422b-9177-973a8826f6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:00.051100 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291d644-ea05-422b-9177-973a8826f6e4 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:00.051603 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291d644-ea05-422b-9177-973a8826f6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:00.052095 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291d644-ea05-422b-9177-973a8826f6e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:00.052944 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291d644-ea05-422b-9177-973a8826f6e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:00.053535 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291d644-ea05-422b-9177-973a8826f6e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:00.055782 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291d644-ea05-422b-9177-973a8826f6e4 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:00.066004 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 146/290] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:00:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:00.072105 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7235ec4-bff1-4101-a8e9-7175f0ac4006 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:00.197132 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7235ec4-bff1-4101-a8e9-7175f0ac4006 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:00.233925 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8c498-ca1a-4369-b660-c73292d03b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:00.235427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8c498-ca1a-4369-b660-c73292d03b81 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:00.235929 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8c498-ca1a-4369-b660-c73292d03b81 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:00.236412 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8c498-ca1a-4369-b660-c73292d03b81 None admin] PATH_INFO: `/v3/users/8d25194609b14edcb5cc262259b5af06` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:00.237767 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8c498-ca1a-4369-b660-c73292d03b81 None admin] RBAC: Authorizing `identity:get_user(user_id=8d25194609b14edcb5cc262259b5af06)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:00.239439 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8c498-ca1a-4369-b660-c73292d03b81 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:00.241355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 145/291] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:01:00 2022] GET /identity/v3/users/8d25194609b14edcb5cc262259b5af06 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:00.251295 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291d644-ea05-422b-9177-973a8826f6e4 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:00.310806 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:00.383736 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291d644-ea05-422b-9177-973a8826f6e4 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:00.419984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fd794-d3eb-4e8d-a400-249401322cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:00.420939 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fd794-d3eb-4e8d-a400-249401322cb7 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:00.421416 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fd794-d3eb-4e8d-a400-249401322cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:00.421914 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fd794-d3eb-4e8d-a400-249401322cb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:00.495057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fd794-d3eb-4e8d-a400-249401322cb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:00.497680 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fd794-d3eb-4e8d-a400-249401322cb7 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:00.544017 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:00.610569 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 147/292] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:00.617510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8c498-ca1a-4369-b660-c73292d03b81 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:00.634209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:00.751663 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8c498-ca1a-4369-b660-c73292d03b81 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:00.793280 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3e017-2cb9-4b76-94c1-c3fc94b89225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:00.793915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3e017-2cb9-4b76-94c1-c3fc94b89225 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:00.794198 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3e017-2cb9-4b76-94c1-c3fc94b89225 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:00.794475 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3e017-2cb9-4b76-94c1-c3fc94b89225 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:00.795656 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3e017-2cb9-4b76-94c1-c3fc94b89225 None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:00.797096 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3e017-2cb9-4b76-94c1-c3fc94b89225 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:00.798858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 146/293] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:00 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:00.804837 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fd794-d3eb-4e8d-a400-249401322cb7 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:00.816943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494771c-6a02-4dc9-b40b-335e91d7754a None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:00.817225 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494771c-6a02-4dc9-b40b-335e91d7754a None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:00.817497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494771c-6a02-4dc9-b40b-335e91d7754a None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:00.823701 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 147/294] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:00.829257 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e1705-6e7e-46e1-89e5-890a877b4db5 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:00.829542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e1705-6e7e-46e1-89e5-890a877b4db5 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:00.829816 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e1705-6e7e-46e1-89e5-890a877b4db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:00.864534 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-d84e1705-6e7e-46e1-89e5-890a877b4db5 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:00.865913 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-d84e1705-6e7e-46e1-89e5-890a877b4db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:00.970387 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 148/295] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:01.015666 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fd794-d3eb-4e8d-a400-249401322cb7 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:01.068473 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32db63-414c-4b47-a6af-157544293dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:01.069270 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32db63-414c-4b47-a6af-157544293dda None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:01.069610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32db63-414c-4b47-a6af-157544293dda None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:01.069914 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32db63-414c-4b47-a6af-157544293dda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:01.070801 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32db63-414c-4b47-a6af-157544293dda None admin] RBAC: Adding query filter params (role.id=70cebcd047db4003b7016de5c93cab80, scope.project.id=59b28d193e75472297193587da13dcc8, user.id=8d25194609b14edcb5cc262259b5af06) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:01.076046 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32db63-414c-4b47-a6af-157544293dda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:01.077601 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32db63-414c-4b47-a6af-157544293dda None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:01.084981 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 148/296] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:01:00 2022] GET /identity/v3/role_assignments?user.id=8d25194609b14edcb5cc262259b5af06&scope.project.id=59b28d193e75472297193587da13dcc8&role.id=70cebcd047db4003b7016de5c93cab80 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:01.193812 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff981f-0312-4488-b77a-6279457a5582 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:01.194152 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff981f-0312-4488-b77a-6279457a5582 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:01.194417 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff981f-0312-4488-b77a-6279457a5582 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:01.196081 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 149/297] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:01.202787 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3884c-ccbd-4708-bbf9-7398982f91a9 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:01.203141 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3884c-ccbd-4708-bbf9-7398982f91a9 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:01.203378 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3884c-ccbd-4708-bbf9-7398982f91a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:01.225171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:01.235298 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-a6a3884c-ccbd-4708-bbf9-7398982f91a9 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:01.236601 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-a6a3884c-ccbd-4708-bbf9-7398982f91a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:01.261999 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b464c-4c53-48b1-9691-04786cef8bd3 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:01.262563 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b464c-4c53-48b1-9691-04786cef8bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:01.262788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b464c-4c53-48b1-9691-04786cef8bd3 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:01.264530 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 150/298] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:01.276431 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a6a25-89ac-48ae-9889-168e279f536c None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:01.276761 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a6a25-89ac-48ae-9889-168e279f536c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:01.276985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a6a25-89ac-48ae-9889-168e279f536c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:01.318117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-a39a6a25-89ac-48ae-9889-168e279f536c None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:01.318117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-a39a6a25-89ac-48ae-9889-168e279f536c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:01.330199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:01.349177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 149/299] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:01.408387 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 151/300] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:01.446238 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3884c-ccbd-4708-bbf9-7398982f91a9 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:01.562803 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3884c-ccbd-4708-bbf9-7398982f91a9 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:01.614644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb10b8-9625-4d4d-a59d-09f7b9f1c6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:01.615303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb10b8-9625-4d4d-a59d-09f7b9f1c6a8 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:01.615592 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb10b8-9625-4d4d-a59d-09f7b9f1c6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:01.615867 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb10b8-9625-4d4d-a59d-09f7b9f1c6a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:01.619108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:01.632115 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb10b8-9625-4d4d-a59d-09f7b9f1c6a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-41eb10b8-9625-4d4d-a59d-09f7b9f1c6a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:01.637494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:01.638354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:01.640177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:01.640177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:01.640177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:01.640177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:01.640177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:01.640177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:01.640177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:01.640177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:01.640177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:01.640177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:01.640177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:01.640177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:01.640177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 150/301] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:01.648407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a6a25-89ac-48ae-9889-168e279f536c None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:01.706973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb10b8-9625-4d4d-a59d-09f7b9f1c6a8 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:01.755385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a6a25-89ac-48ae-9889-168e279f536c None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:01.798573 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6e99c-7794-46b5-a017-6d657f392150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:01.799629 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6e99c-7794-46b5-a017-6d657f392150 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:01.799917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6e99c-7794-46b5-a017-6d657f392150 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:01.800195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6e99c-7794-46b5-a017-6d657f392150 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:01.800877 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6e99c-7794-46b5-a017-6d657f392150 None admin] RBAC: Adding query filter params (name=member) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:01.801531 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6e99c-7794-46b5-a017-6d657f392150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:01.804060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6e99c-7794-46b5-a017-6d657f392150 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:01.813599 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 152/302] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:01:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:01.818593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6e99c-7794-46b5-a017-6d657f392150 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:01.822977 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:01.830878 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb10b8-9625-4d4d-a59d-09f7b9f1c6a8 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:01.874769 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48580f-1015-4831-93e9-1571cfa7e4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:01.875519 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48580f-1015-4831-93e9-1571cfa7e4e7 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:01.877253 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48580f-1015-4831-93e9-1571cfa7e4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:01.877533 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48580f-1015-4831-93e9-1571cfa7e4e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:01.892191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48580f-1015-4831-93e9-1571cfa7e4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-ac48580f-1015-4831-93e9-1571cfa7e4e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:01.897142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:01.898640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:01.899495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:01.899495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:01.899495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:01.899495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:01.899495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:01.899495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:01.899495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:01.899495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:01.899495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:01.899495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:01.899495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:01:01.899495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:01.899495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 151/303] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:01:01.900162 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48580f-1015-4831-93e9-1571cfa7e4e7 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:01.928602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6e99c-7794-46b5-a017-6d657f392150 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:01.961088 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:01.966512 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a2556-27f6-4453-8ea7-7f87dc46f000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:01.967147 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a2556-27f6-4453-8ea7-7f87dc46f000 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:01.967467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a2556-27f6-4453-8ea7-7f87dc46f000 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:01.967742 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a2556-27f6-4453-8ea7-7f87dc46f000 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:01.968875 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a2556-27f6-4453-8ea7-7f87dc46f000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:01.970324 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a2556-27f6-4453-8ea7-7f87dc46f000 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:01.975311 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 153/304] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:01.975311 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a2556-27f6-4453-8ea7-7f87dc46f000 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:02.012864 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48580f-1015-4831-93e9-1571cfa7e4e7 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:02.049618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410ac1f-a72c-46ef-8ad6-89ec5c38cd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:02.050276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ac1f-a72c-46ef-8ad6-89ec5c38cd15 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:02.050557 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ac1f-a72c-46ef-8ad6-89ec5c38cd15 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:02.050834 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ac1f-a72c-46ef-8ad6-89ec5c38cd15 None admin] PATH_INFO: `/v3/users/4c8b0ad662d04ebf9a4c93851a7ea99c` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:02.052036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410ac1f-a72c-46ef-8ad6-89ec5c38cd15 None admin] RBAC: Authorizing `identity:get_user(user_id=4c8b0ad662d04ebf9a4c93851a7ea99c)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:02.053590 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410ac1f-a72c-46ef-8ad6-89ec5c38cd15 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:02.055388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 152/305] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:01:01 2022] GET /identity/v3/users/4c8b0ad662d04ebf9a4c93851a7ea99c => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:02.055978 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410ac1f-a72c-46ef-8ad6-89ec5c38cd15 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:02.067175 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:02.102765 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a2556-27f6-4453-8ea7-7f87dc46f000 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:02.140213 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e9fe9-d32e-473b-a93a-95af07baedfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:02.140823 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e9fe9-d32e-473b-a93a-95af07baedfd None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:02.141395 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e9fe9-d32e-473b-a93a-95af07baedfd None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:02.141395 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e9fe9-d32e-473b-a93a-95af07baedfd None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:02.142025 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e9fe9-d32e-473b-a93a-95af07baedfd None admin] RBAC: Adding query filter params (name=reader) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:02.142330 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e9fe9-d32e-473b-a93a-95af07baedfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:02.143745 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e9fe9-d32e-473b-a93a-95af07baedfd None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:02.152873 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 154/306] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:01:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:02.153472 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e9fe9-d32e-473b-a93a-95af07baedfd None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:02.172767 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410ac1f-a72c-46ef-8ad6-89ec5c38cd15 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:02.200743 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:02.213412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11385e7-989c-4520-97d4-619be9aefe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:02.214021 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11385e7-989c-4520-97d4-619be9aefe6a None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:02.214353 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11385e7-989c-4520-97d4-619be9aefe6a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:02.214627 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11385e7-989c-4520-97d4-619be9aefe6a None admin] PATH_INFO: `/v3/groups` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:02.215302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11385e7-989c-4520-97d4-619be9aefe6a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:02.216747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11385e7-989c-4520-97d4-619be9aefe6a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:02.233498 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 153/307] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Aug 18 21:01:02 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:01:02.234315 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11385e7-989c-4520-97d4-619be9aefe6a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:02.273266 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e9fe9-d32e-473b-a93a-95af07baedfd None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:02.312648 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7a6c5-87da-4594-82b3-97b690c46dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:02.313598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7a6c5-87da-4594-82b3-97b690c46dbd None admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:02.314030 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7a6c5-87da-4594-82b3-97b690c46dbd None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:02.314445 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7a6c5-87da-4594-82b3-97b690c46dbd None admin] PATH_INFO: `/v3/system/users/4c8b0ad662d04ebf9a4c93851a7ea99c/roles/70cebcd047db4003b7016de5c93cab80` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:02.316275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7a6c5-87da-4594-82b3-97b690c46dbd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4c8b0ad662d04ebf9a4c93851a7ea99c, role_id=70cebcd047db4003b7016de5c93cab80)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:02.317991 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7a6c5-87da-4594-82b3-97b690c46dbd None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:02.320743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:02.339532 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 155/308] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Aug 18 21:01:02 2022] PUT /identity/v3/system/users/4c8b0ad662d04ebf9a4c93851a7ea99c/roles/70cebcd047db4003b7016de5c93cab80 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:02.395089 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11385e7-989c-4520-97d4-619be9aefe6a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:02.436832 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead598c0-72c9-422c-a5c2-03b1b6334e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:02.437482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead598c0-72c9-422c-a5c2-03b1b6334e17 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:02.437765 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead598c0-72c9-422c-a5c2-03b1b6334e17 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:02.438092 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead598c0-72c9-422c-a5c2-03b1b6334e17 None admin] PATH_INFO: `/v3/users/30aae00aa19a44aea0255be1ea0e308c` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:02.454979 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead598c0-72c9-422c-a5c2-03b1b6334e17 None admin] RBAC: Authorizing `identity:get_user(user_id=30aae00aa19a44aea0255be1ea0e308c)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:02.456569 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead598c0-72c9-422c-a5c2-03b1b6334e17 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:02.458372 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 154/309] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:01:02 2022] GET /identity/v3/users/30aae00aa19a44aea0255be1ea0e308c => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:02.464759 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7a6c5-87da-4594-82b3-97b690c46dbd None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:02.508872 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78c8fb-093c-4ddf-8279-d45e264728eb None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:02.509170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78c8fb-093c-4ddf-8279-d45e264728eb None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:02.509430 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78c8fb-093c-4ddf-8279-d45e264728eb None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:02.510794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 155/310] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:02.516647 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818d4bf-58e2-44d7-a560-af11c60f6c1a None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:02.516947 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818d4bf-58e2-44d7-a560-af11c60f6c1a None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:02.517220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818d4bf-58e2-44d7-a560-af11c60f6c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:02.535908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-9818d4bf-58e2-44d7-a560-af11c60f6c1a None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:02.537158 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-9818d4bf-58e2-44d7-a560-af11c60f6c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:02.587767 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:02.596637 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7a6c5-87da-4594-82b3-97b690c46dbd None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:02.626687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 156/311] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:02.641377 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5bdd2-27f3-423f-afe1-3a428a73aee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:02.642023 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5bdd2-27f3-423f-afe1-3a428a73aee0 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:02.642303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5bdd2-27f3-423f-afe1-3a428a73aee0 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:02.642571 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5bdd2-27f3-423f-afe1-3a428a73aee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:02.643303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5bdd2-27f3-423f-afe1-3a428a73aee0 None admin] RBAC: Adding query filter params (role.id=9d0c3738e3c94c5db4b0766c5f44fb11, user.id=30aae00aa19a44aea0255be1ea0e308c, scope.system=all) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:02.643612 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5bdd2-27f3-423f-afe1-3a428a73aee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:02.645038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5bdd2-27f3-423f-afe1-3a428a73aee0 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:02.651007 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 156/312] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Aug 18 21:01:02 2022] GET /identity/v3/role_assignments?user.id=30aae00aa19a44aea0255be1ea0e308c&scope.system=all&role.id=9d0c3738e3c94c5db4b0766c5f44fb11 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:02.955209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818d4bf-58e2-44d7-a560-af11c60f6c1a None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:03.061843 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818d4bf-58e2-44d7-a560-af11c60f6c1a None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:03.098241 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c64a0-1563-40df-b149-7b7dd53703f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:03.098870 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c64a0-1563-40df-b149-7b7dd53703f2 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:03.099147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c64a0-1563-40df-b149-7b7dd53703f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:03.099448 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c64a0-1563-40df-b149-7b7dd53703f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:03.113074 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c64a0-1563-40df-b149-7b7dd53703f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-bf9c64a0-1563-40df-b149-7b7dd53703f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:03.118578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:03.119526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:03.120517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:03.120517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:03.120517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:03.120517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:03.120517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:03.120517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:03.120517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:03.120517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:03.120517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:03.120517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:03.120517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:01:03.120517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:03.120517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 157/313] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:03.125584 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5bdd2-27f3-423f-afe1-3a428a73aee0 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:03.189484 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:03.229693 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5bdd2-27f3-423f-afe1-3a428a73aee0 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:03.263285 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a6f15-c510-479c-adb9-4a324441f52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:03.263891 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a6f15-c510-479c-adb9-4a324441f52b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:03.264170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a6f15-c510-479c-adb9-4a324441f52b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:03.264443 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a6f15-c510-479c-adb9-4a324441f52b None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:03.265145 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a6f15-c510-479c-adb9-4a324441f52b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:03.265456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a6f15-c510-479c-adb9-4a324441f52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:03.266821 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a6f15-c510-479c-adb9-4a324441f52b None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:03.275395 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 157/314] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:01:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:03.284356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c64a0-1563-40df-b149-7b7dd53703f2 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:03.317936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:03.390874 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c64a0-1563-40df-b149-7b7dd53703f2 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:03.426717 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49155d3c-607a-4369-b2c9-432fbbf1f61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:03.427706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155d3c-607a-4369-b2c9-432fbbf1f61d None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:03.428186 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155d3c-607a-4369-b2c9-432fbbf1f61d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:03.428649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155d3c-607a-4369-b2c9-432fbbf1f61d None admin] PATH_INFO: `/v3/users/ce6873f01a8e4a83bfd9af12a568e7d6` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:03.430605 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49155d3c-607a-4369-b2c9-432fbbf1f61d None admin] RBAC: Authorizing `identity:get_user(user_id=ce6873f01a8e4a83bfd9af12a568e7d6)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:03.432377 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49155d3c-607a-4369-b2c9-432fbbf1f61d None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:03.434584 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 158/315] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:01:03 2022] GET /identity/v3/users/ce6873f01a8e4a83bfd9af12a568e7d6 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:03.440276 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a6f15-c510-479c-adb9-4a324441f52b None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:03.550906 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a6f15-c510-479c-adb9-4a324441f52b None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:03.587292 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:03.592943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642e55a-ca6d-4ef4-a8a2-cfa8f40927f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:03.593554 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642e55a-ca6d-4ef4-a8a2-cfa8f40927f1 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:03.593891 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642e55a-ca6d-4ef4-a8a2-cfa8f40927f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:03.594170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642e55a-ca6d-4ef4-a8a2-cfa8f40927f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:03.669547 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642e55a-ca6d-4ef4-a8a2-cfa8f40927f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:03.671393 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642e55a-ca6d-4ef4-a8a2-cfa8f40927f1 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:03.773797 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 158/316] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:03.779330 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49155d3c-607a-4369-b2c9-432fbbf1f61d None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:03.878967 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:03.881123 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49155d3c-607a-4369-b2c9-432fbbf1f61d None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:03.915745 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98f3af-de2f-4fd6-ac63-b1bf4052fb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:03.916362 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98f3af-de2f-4fd6-ac63-b1bf4052fb35 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:03.916638 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98f3af-de2f-4fd6-ac63-b1bf4052fb35 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:03.916908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98f3af-de2f-4fd6-ac63-b1bf4052fb35 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:03.918010 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98f3af-de2f-4fd6-ac63-b1bf4052fb35 None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:03.919482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98f3af-de2f-4fd6-ac63-b1bf4052fb35 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:03.921394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 159/317] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:03 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:03.927099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642e55a-ca6d-4ef4-a8a2-cfa8f40927f1 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:03.963671 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:04.032678 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642e55a-ca6d-4ef4-a8a2-cfa8f40927f1 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:04.066590 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732647d3-7e6c-454b-8cd5-5b3445b9faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:04.067190 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732647d3-7e6c-454b-8cd5-5b3445b9faaf None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:04.067494 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732647d3-7e6c-454b-8cd5-5b3445b9faaf None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:04.067763 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732647d3-7e6c-454b-8cd5-5b3445b9faaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:04.068473 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732647d3-7e6c-454b-8cd5-5b3445b9faaf None admin] RBAC: Adding query filter params (role.id=9d0c3738e3c94c5db4b0766c5f44fb11, scope.project.id=59b28d193e75472297193587da13dcc8, user.id=ce6873f01a8e4a83bfd9af12a568e7d6) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:04.068777 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732647d3-7e6c-454b-8cd5-5b3445b9faaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:04.070731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732647d3-7e6c-454b-8cd5-5b3445b9faaf None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:04.077226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 159/318] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:01:03 2022] GET /identity/v3/role_assignments?user.id=ce6873f01a8e4a83bfd9af12a568e7d6&scope.project.id=59b28d193e75472297193587da13dcc8&role.id=9d0c3738e3c94c5db4b0766c5f44fb11 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:04.578513 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b2dd0-4aa0-4021-8651-635e89b5de88 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:04.578903 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b2dd0-4aa0-4021-8651-635e89b5de88 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:04.579099 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b2dd0-4aa0-4021-8651-635e89b5de88 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:04.580422 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 160/319] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:04.585928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba32534-92a8-48a5-bef3-efb6a076a681 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:04.586372 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba32534-92a8-48a5-bef3-efb6a076a681 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:04.586535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba32534-92a8-48a5-bef3-efb6a076a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:04.604356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-2ba32534-92a8-48a5-bef3-efb6a076a681 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:04.605543 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-2ba32534-92a8-48a5-bef3-efb6a076a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:04.681909 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 160/320] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:04.789683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758a78e-0753-41e7-bf71-d84149783c24 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:04.790215 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758a78e-0753-41e7-bf71-d84149783c24 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:04.790215 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758a78e-0753-41e7-bf71-d84149783c24 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:04.791752 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 161/321] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:04.796656 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe086e-b8b4-42d3-a915-a3e84ce6534b None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:04.796950 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe086e-b8b4-42d3-a915-a3e84ce6534b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:04.797226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe086e-b8b4-42d3-a915-a3e84ce6534b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:04.815421 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-d7fe086e-b8b4-42d3-a915-a3e84ce6534b None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:04.816608 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-d7fe086e-b8b4-42d3-a915-a3e84ce6534b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:04.832218 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:04.853766 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b040e-2d7a-4f9a-ba06-2d217f640eb2 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:04.854053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b040e-2d7a-4f9a-ba06-2d217f640eb2 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:04.854323 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b040e-2d7a-4f9a-ba06-2d217f640eb2 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:04.855811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 162/322] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:01:04.860369 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f0ab5-7cca-430a-9634-8c1dac7ff297 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:04.860649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f0ab5-7cca-430a-9634-8c1dac7ff297 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:04.860921 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f0ab5-7cca-430a-9634-8c1dac7ff297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:04.878101 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-723f0ab5-7cca-430a-9634-8c1dac7ff297 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:04.879289 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-723f0ab5-7cca-430a-9634-8c1dac7ff297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:04.890439 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 161/323] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:04.947881 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 163/324] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:05.004735 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe086e-b8b4-42d3-a915-a3e84ce6534b None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:05.109875 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe086e-b8b4-42d3-a915-a3e84ce6534b None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:05.144782 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b2b62-1b4c-40ac-a442-2c0217c27268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:05.145464 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b2b62-1b4c-40ac-a442-2c0217c27268 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:05.145755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b2b62-1b4c-40ac-a442-2c0217c27268 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:05.146068 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b2b62-1b4c-40ac-a442-2c0217c27268 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:05.147169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b2b62-1b4c-40ac-a442-2c0217c27268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:05.149170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b2b62-1b4c-40ac-a442-2c0217c27268 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:05.155343 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 162/325] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:05.156535 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f0ab5-7cca-430a-9634-8c1dac7ff297 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:05.217929 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b2b62-1b4c-40ac-a442-2c0217c27268 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:05.240247 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:05.258330 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:05.262762 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f0ab5-7cca-430a-9634-8c1dac7ff297 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:05.300487 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9158728-4f70-42eb-b35c-37bde729e7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:05.301112 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158728-4f70-42eb-b35c-37bde729e7c4 None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:05.301389 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158728-4f70-42eb-b35c-37bde729e7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:05.301659 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158728-4f70-42eb-b35c-37bde729e7c4 None admin] PATH_INFO: `/v3/groups` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:05.302280 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9158728-4f70-42eb-b35c-37bde729e7c4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:05.303746 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9158728-4f70-42eb-b35c-37bde729e7c4 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:05.318759 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 164/326] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Aug 18 21:01:05 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:01:05.319988 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9158728-4f70-42eb-b35c-37bde729e7c4 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:05.341559 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b2b62-1b4c-40ac-a442-2c0217c27268 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:05.380359 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604458b-9ddf-4c2d-8911-02507dd0a0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:05.380914 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604458b-9ddf-4c2d-8911-02507dd0a0d9 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:05.381194 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604458b-9ddf-4c2d-8911-02507dd0a0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:05.381463 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604458b-9ddf-4c2d-8911-02507dd0a0d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:05.393751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604458b-9ddf-4c2d-8911-02507dd0a0d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-a604458b-9ddf-4c2d-8911-02507dd0a0d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:05.398780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:05.399764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:05.400542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:05.400542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:05.400542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:05.400542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:05.400542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:05.400542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:05.400542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:05.400542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:05.400542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:05.400542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:05.400542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:05.400542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:05.400542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 163/327] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:05.406163 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604458b-9ddf-4c2d-8911-02507dd0a0d9 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:05.440585 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9158728-4f70-42eb-b35c-37bde729e7c4 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:05.476930 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2353e82-a2c9-4ebe-8f3f-e0e4b607817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:05.477573 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2353e82-a2c9-4ebe-8f3f-e0e4b607817d None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:05.477846 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2353e82-a2c9-4ebe-8f3f-e0e4b607817d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:05.478121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2353e82-a2c9-4ebe-8f3f-e0e4b607817d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:05.490319 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2353e82-a2c9-4ebe-8f3f-e0e4b607817d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:05.494574 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-d2353e82-a2c9-4ebe-8f3f-e0e4b607817d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:05.497341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:05.498427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:05.499568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:05.499568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:05.499568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:05.499568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:05.499568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:05.499568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:05.499568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:05.499568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:05.499568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:05.499568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:05.499568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:01:05.499568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:05.499568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 165/328] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:05.503813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2353e82-a2c9-4ebe-8f3f-e0e4b607817d None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:05.524045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:05.527229 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604458b-9ddf-4c2d-8911-02507dd0a0d9 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:05.573879 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe141e2c-800a-4dbb-9c1a-e9fb9908245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:05.574489 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe141e2c-800a-4dbb-9c1a-e9fb9908245d None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:05.575092 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe141e2c-800a-4dbb-9c1a-e9fb9908245d None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:05.575323 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe141e2c-800a-4dbb-9c1a-e9fb9908245d None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:05.578795 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe141e2c-800a-4dbb-9c1a-e9fb9908245d None admin] RBAC: Adding query filter params (name=member) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:05.579120 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe141e2c-800a-4dbb-9c1a-e9fb9908245d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:05.581084 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe141e2c-800a-4dbb-9c1a-e9fb9908245d None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:05.593905 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 164/329] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:01:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:05.600005 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe141e2c-800a-4dbb-9c1a-e9fb9908245d None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:05.635021 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2353e82-a2c9-4ebe-8f3f-e0e4b607817d None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:05.682512 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee130a93-3d80-490b-a79f-e7861ae5c63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:05.683293 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee130a93-3d80-490b-a79f-e7861ae5c63a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:05.683593 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee130a93-3d80-490b-a79f-e7861ae5c63a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:05.683867 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee130a93-3d80-490b-a79f-e7861ae5c63a None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:05.684536 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee130a93-3d80-490b-a79f-e7861ae5c63a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:05.684843 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee130a93-3d80-490b-a79f-e7861ae5c63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:05.686223 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee130a93-3d80-490b-a79f-e7861ae5c63a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:05.696666 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 166/330] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:01:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:05.702673 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee130a93-3d80-490b-a79f-e7861ae5c63a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:05.722385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe141e2c-800a-4dbb-9c1a-e9fb9908245d None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:05.769255 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a576ae-c7b4-41f3-afbc-203c878e440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:05.769892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a576ae-c7b4-41f3-afbc-203c878e440c None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:05.770232 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a576ae-c7b4-41f3-afbc-203c878e440c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:05.770510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a576ae-c7b4-41f3-afbc-203c878e440c None admin] PATH_INFO: `/v3/users/4c8b0ad662d04ebf9a4c93851a7ea99c` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:05.774181 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a576ae-c7b4-41f3-afbc-203c878e440c None admin] RBAC: Authorizing `identity:get_user(user_id=4c8b0ad662d04ebf9a4c93851a7ea99c)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:05.774181 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a576ae-c7b4-41f3-afbc-203c878e440c None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:05.775806 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 165/331] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:01:05 2022] GET /identity/v3/users/4c8b0ad662d04ebf9a4c93851a7ea99c => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:05.782224 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a576ae-c7b4-41f3-afbc-203c878e440c None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:05.792460 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:05.810136 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:05.837521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee130a93-3d80-490b-a79f-e7861ae5c63a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:05.875186 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e70ce-23e6-4b6d-ac79-45175df8b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:05.876322 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e70ce-23e6-4b6d-ac79-45175df8b47f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:05.876820 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e70ce-23e6-4b6d-ac79-45175df8b47f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:05.877239 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e70ce-23e6-4b6d-ac79-45175df8b47f None admin] PATH_INFO: `/v3/users/30aae00aa19a44aea0255be1ea0e308c` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:05.878669 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e70ce-23e6-4b6d-ac79-45175df8b47f None admin] RBAC: Authorizing `identity:get_user(user_id=30aae00aa19a44aea0255be1ea0e308c)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:05.880357 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e70ce-23e6-4b6d-ac79-45175df8b47f None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:05.883082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 167/332] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:01:05 2022] GET /identity/v3/users/30aae00aa19a44aea0255be1ea0e308c => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:05.888686 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e70ce-23e6-4b6d-ac79-45175df8b47f None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:05.894775 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a576ae-c7b4-41f3-afbc-203c878e440c None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:05.930289 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba7379-b3c3-4f04-af3d-22039febcec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:05.930902 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba7379-b3c3-4f04-af3d-22039febcec7 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:05.931184 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba7379-b3c3-4f04-af3d-22039febcec7 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:05.931492 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba7379-b3c3-4f04-af3d-22039febcec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:05.932220 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba7379-b3c3-4f04-af3d-22039febcec7 None admin] RBAC: Adding query filter params (role.id=70cebcd047db4003b7016de5c93cab80, user.id=4c8b0ad662d04ebf9a4c93851a7ea99c, scope.system=all) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:05.932534 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba7379-b3c3-4f04-af3d-22039febcec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:05.933982 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba7379-b3c3-4f04-af3d-22039febcec7 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:05.947117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 166/333] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Aug 18 21:01:05 2022] GET /identity/v3/role_assignments?user.id=4c8b0ad662d04ebf9a4c93851a7ea99c&scope.system=all&role.id=70cebcd047db4003b7016de5c93cab80 => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:06.018362 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e70ce-23e6-4b6d-ac79-45175df8b47f None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:06.056921 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bdb34-d5a4-484e-b3f2-2d913c8fa257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:06.057596 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bdb34-d5a4-484e-b3f2-2d913c8fa257 None admin] REQUEST_METHOD: `PUT` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:06.057882 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bdb34-d5a4-484e-b3f2-2d913c8fa257 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:06.058160 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bdb34-d5a4-484e-b3f2-2d913c8fa257 None admin] PATH_INFO: `/v3/system/users/30aae00aa19a44aea0255be1ea0e308c/roles/9d0c3738e3c94c5db4b0766c5f44fb11` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:06.059716 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bdb34-d5a4-484e-b3f2-2d913c8fa257 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=30aae00aa19a44aea0255be1ea0e308c, role_id=9d0c3738e3c94c5db4b0766c5f44fb11)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:06.061146 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bdb34-d5a4-484e-b3f2-2d913c8fa257 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:06.072103 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 168/334] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Aug 18 21:01:05 2022] PUT /identity/v3/system/users/30aae00aa19a44aea0255be1ea0e308c/roles/9d0c3738e3c94c5db4b0766c5f44fb11 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:08.086170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90015572-1896-40b3-9fc9-ca5e3e89f3cc None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.087143 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90015572-1896-40b3-9fc9-ca5e3e89f3cc None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.087614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90015572-1896-40b3-9fc9-ca5e3e89f3cc None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.089137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 167/335] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:08.094775 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049661a-3079-4dc5-b4ab-e53055ed62db None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.095713 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049661a-3079-4dc5-b4ab-e53055ed62db None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.096166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049661a-3079-4dc5-b4ab-e53055ed62db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.120289 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-2049661a-3079-4dc5-b4ab-e53055ed62db None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:08.121795 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-2049661a-3079-4dc5-b4ab-e53055ed62db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:08.130259 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:08.217842 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 169/336] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:08.374997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9299d7-d523-4d9d-8bfe-2ccfb913819c None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.375324 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9299d7-d523-4d9d-8bfe-2ccfb913819c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.375533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9299d7-d523-4d9d-8bfe-2ccfb913819c None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.377157 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 168/337] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:08.383552 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54abbd1-e57a-4669-8ff2-338bc3dbf483 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.383843 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54abbd1-e57a-4669-8ff2-338bc3dbf483 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.384120 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54abbd1-e57a-4669-8ff2-338bc3dbf483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.411384 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-e54abbd1-e57a-4669-8ff2-338bc3dbf483 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:08.412775 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-e54abbd1-e57a-4669-8ff2-338bc3dbf483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:08.505881 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 170/338] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:08.640337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd915e-e7ff-464b-802e-9c644e310bd3 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.640855 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd915e-e7ff-464b-802e-9c644e310bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.641367 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd915e-e7ff-464b-802e-9c644e310bd3 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.643187 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 169/339] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:08.648300 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053edfb-04ac-4224-bb3d-0dd06c9917a2 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.648821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053edfb-04ac-4224-bb3d-0dd06c9917a2 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.649299 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053edfb-04ac-4224-bb3d-0dd06c9917a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.674347 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-4053edfb-04ac-4224-bb3d-0dd06c9917a2 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:08.675953 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-4053edfb-04ac-4224-bb3d-0dd06c9917a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:08.761275 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 171/340] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:08.890795 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd915e-e7ff-464b-802e-9c644e310bd3 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:08.957623 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b895e49-4d31-4af7-b43a-54313aab1f11 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.957623 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b895e49-4d31-4af7-b43a-54313aab1f11 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.957623 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b895e49-4d31-4af7-b43a-54313aab1f11 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.957623 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 172/341] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:01:08.965325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ac3bf-a356-40d1-aada-348a9e46a25b None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.965842 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ac3bf-a356-40d1-aada-348a9e46a25b None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.966293 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ac3bf-a356-40d1-aada-348a9e46a25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.973150 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:08.973912 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:08.989068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-216ac3bf-a356-40d1-aada-348a9e46a25b None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:08.990541 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-216ac3bf-a356-40d1-aada-348a9e46a25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:09.063073 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd915e-e7ff-464b-802e-9c644e310bd3 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.078395 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 173/342] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:09.128452 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fe759-959b-4e3d-a5c6-41ba125af931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.129084 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fe759-959b-4e3d-a5c6-41ba125af931 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.129366 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fe759-959b-4e3d-a5c6-41ba125af931 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.129638 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fe759-959b-4e3d-a5c6-41ba125af931 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.147686 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fe759-959b-4e3d-a5c6-41ba125af931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-b31fe759-959b-4e3d-a5c6-41ba125af931 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:09.155702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:09.156628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:09.157456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:09.157456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:09.157456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:09.157456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:09.157456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:09.157456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:09.157456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:09.157456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:09.157456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:09.157456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:09.157456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:09.157456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:09.157456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 170/343] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:09.162996 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ac3bf-a356-40d1-aada-348a9e46a25b None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.178627 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fe759-959b-4e3d-a5c6-41ba125af931 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.322495 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fe759-959b-4e3d-a5c6-41ba125af931 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.339587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ac3bf-a356-40d1-aada-348a9e46a25b None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.349311 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:09.367816 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdda8b-ddf7-4933-b444-30bc1c302354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.368797 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdda8b-ddf7-4933-b444-30bc1c302354 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.369349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdda8b-ddf7-4933-b444-30bc1c302354 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.369821 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdda8b-ddf7-4933-b444-30bc1c302354 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.375323 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:09.386564 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdda8b-ddf7-4933-b444-30bc1c302354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:09.389557 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00875d95-b6c0-4b9a-8af7-8ce0322fce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.390183 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00875d95-b6c0-4b9a-8af7-8ce0322fce72 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.390462 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00875d95-b6c0-4b9a-8af7-8ce0322fce72 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.390787 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00875d95-b6c0-4b9a-8af7-8ce0322fce72 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.391485 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00875d95-b6c0-4b9a-8af7-8ce0322fce72 None admin] RBAC: Adding query filter params (name=member) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:09.391796 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00875d95-b6c0-4b9a-8af7-8ce0322fce72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:09.393168 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00875d95-b6c0-4b9a-8af7-8ce0322fce72 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-16fdda8b-ddf7-4933-b444-30bc1c302354 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:09.399356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:09.400240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:09.401032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:09.401032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:09.401032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:09.401032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:09.401032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:09.401032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:09.401032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:09.401032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:09.401032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:09.401032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:09.401032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:01:09.401032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:09.403723 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 171/344] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:01:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:09.406657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 174/345] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:01:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:09.409747 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdda8b-ddf7-4933-b444-30bc1c302354 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.412087 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00875d95-b6c0-4b9a-8af7-8ce0322fce72 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.546088 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00875d95-b6c0-4b9a-8af7-8ce0322fce72 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.558064 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdda8b-ddf7-4933-b444-30bc1c302354 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.589399 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de7732-e1bb-4ade-8234-f117573dbad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.590263 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de7732-e1bb-4ade-8234-f117573dbad9 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.590669 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de7732-e1bb-4ade-8234-f117573dbad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.591067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de7732-e1bb-4ade-8234-f117573dbad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.596967 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add3f22-18a5-4bad-9317-a6d598cd9bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.597579 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add3f22-18a5-4bad-9317-a6d598cd9bcc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.597860 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add3f22-18a5-4bad-9317-a6d598cd9bcc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.598131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add3f22-18a5-4bad-9317-a6d598cd9bcc None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.601908 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add3f22-18a5-4bad-9317-a6d598cd9bcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:09.601908 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add3f22-18a5-4bad-9317-a6d598cd9bcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:09.601908 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add3f22-18a5-4bad-9317-a6d598cd9bcc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:09.611979 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 172/346] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:09.611979 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add3f22-18a5-4bad-9317-a6d598cd9bcc None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.658880 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:09.676016 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de7732-e1bb-4ade-8234-f117573dbad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:09.677502 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de7732-e1bb-4ade-8234-f117573dbad9 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:09.679554 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:09.716994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add3f22-18a5-4bad-9317-a6d598cd9bcc None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.753134 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93087d5-5f1a-44a6-ac8d-dd19266b4e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.753771 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93087d5-5f1a-44a6-ac8d-dd19266b4e4a None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.754051 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93087d5-5f1a-44a6-ac8d-dd19266b4e4a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.754324 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93087d5-5f1a-44a6-ac8d-dd19266b4e4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.765558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93087d5-5f1a-44a6-ac8d-dd19266b4e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-f93087d5-5f1a-44a6-ac8d-dd19266b4e4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:09.770743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:09.771928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 173/347] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:09.773122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93087d5-5f1a-44a6-ac8d-dd19266b4e4a None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.793473 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 175/348] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:09.798962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de7732-e1bb-4ade-8234-f117573dbad9 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.877868 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93087d5-5f1a-44a6-ac8d-dd19266b4e4a None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.885857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:09.916683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147a343-2cb9-4da5-b1ac-e110f7d271a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.917276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:09.918342 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147a343-2cb9-4da5-b1ac-e110f7d271a3 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.918686 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147a343-2cb9-4da5-b1ac-e110f7d271a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.919027 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147a343-2cb9-4da5-b1ac-e110f7d271a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.920410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de7732-e1bb-4ade-8234-f117573dbad9 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.930433 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147a343-2cb9-4da5-b1ac-e110f7d271a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-5147a343-2cb9-4da5-b1ac-e110f7d271a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:09.935169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:09.936091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:09.936886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:09.936886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:09.936886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:09.936886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:09.936886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:09.936886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:09.936886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:09.936886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:09.936886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:09.936886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:09.936886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:09.936886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:09.936886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 174/349] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:09.937535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147a343-2cb9-4da5-b1ac-e110f7d271a3 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.962434 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2d910-0628-40df-858c-c88379a8061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.963388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2d910-0628-40df-858c-c88379a8061c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.963812 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2d910-0628-40df-858c-c88379a8061c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.964216 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2d910-0628-40df-858c-c88379a8061c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:10.041252 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2d910-0628-40df-858c-c88379a8061c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:10.043237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2d910-0628-40df-858c-c88379a8061c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:10.045219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147a343-2cb9-4da5-b1ac-e110f7d271a3 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:10.082207 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc60227-94e8-4170-a767-ab9d2586b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:10.082818 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc60227-94e8-4170-a767-ab9d2586b8c2 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:10.083099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc60227-94e8-4170-a767-ab9d2586b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:10.083411 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc60227-94e8-4170-a767-ab9d2586b8c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:10.085224 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc60227-94e8-4170-a767-ab9d2586b8c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:10.085224 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc60227-94e8-4170-a767-ab9d2586b8c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:10.086302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc60227-94e8-4170-a767-ab9d2586b8c2 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:10.095090 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 175/350] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:01:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:10.095987 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc60227-94e8-4170-a767-ab9d2586b8c2 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:10.130449 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:10.151657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:10.160313 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 176/351] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:10.161464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2d910-0628-40df-858c-c88379a8061c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:10.223857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc60227-94e8-4170-a767-ab9d2586b8c2 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:10.270678 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e6575-19f4-41e2-a372-114ced3f0bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:10.271546 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e6575-19f4-41e2-a372-114ced3f0bcb None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:10.271826 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e6575-19f4-41e2-a372-114ced3f0bcb None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:10.272763 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e6575-19f4-41e2-a372-114ced3f0bcb None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:10.277153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e6575-19f4-41e2-a372-114ced3f0bcb None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:10.277153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e6575-19f4-41e2-a372-114ced3f0bcb None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:10.277517 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 176/352] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:10 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:10.278473 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e6575-19f4-41e2-a372-114ced3f0bcb None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:10.311161 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2d910-0628-40df-858c-c88379a8061c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:10.349705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ba2cf-9eb4-4bb2-b618-d59453ab20dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:10.350838 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ba2cf-9eb4-4bb2-b618-d59453ab20dc None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:10.351444 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ba2cf-9eb4-4bb2-b618-d59453ab20dc None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:10.351949 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ba2cf-9eb4-4bb2-b618-d59453ab20dc None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:10.352988 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ba2cf-9eb4-4bb2-b618-d59453ab20dc None admin] RBAC: Adding query filter params (name=member) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:10.353499 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ba2cf-9eb4-4bb2-b618-d59453ab20dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:10.355321 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ba2cf-9eb4-4bb2-b618-d59453ab20dc None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:10.367974 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 177/353] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:01:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:10.369350 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ba2cf-9eb4-4bb2-b618-d59453ab20dc None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:10.385501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:10.392852 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e6575-19f4-41e2-a372-114ced3f0bcb None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:10.437171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:10.441425 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfc361-33b7-44a7-8884-a17c428e84fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:10.441867 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfc361-33b7-44a7-8884-a17c428e84fe None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:10.442147 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfc361-33b7-44a7-8884-a17c428e84fe None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:10.442421 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfc361-33b7-44a7-8884-a17c428e84fe None admin] PATH_INFO: `/v3/users/30aae00aa19a44aea0255be1ea0e308c` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:10.444356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfc361-33b7-44a7-8884-a17c428e84fe None admin] RBAC: Authorizing `identity:get_user(user_id=30aae00aa19a44aea0255be1ea0e308c)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:10.445795 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfc361-33b7-44a7-8884-a17c428e84fe None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:10.447738 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 177/354] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Aug 18 21:01:10 2022] GET /identity/v3/users/30aae00aa19a44aea0255be1ea0e308c => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:10.448573 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfc361-33b7-44a7-8884-a17c428e84fe None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:10.498429 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ba2cf-9eb4-4bb2-b618-d59453ab20dc None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:10.540450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3fd4-a187-49f3-be23-4503653ecb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:10.541121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3fd4-a187-49f3-be23-4503653ecb26 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:10.541366 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3fd4-a187-49f3-be23-4503653ecb26 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:10.541639 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3fd4-a187-49f3-be23-4503653ecb26 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:10.542759 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3fd4-a187-49f3-be23-4503653ecb26 None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:10.544240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3fd4-a187-49f3-be23-4503653ecb26 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:10.546022 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 178/355] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:10 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:10.550060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1b8d-4e3f-4da9-8bed-4dbeed441373 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:10.550060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1b8d-4e3f-4da9-8bed-4dbeed441373 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:10.550060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1b8d-4e3f-4da9-8bed-4dbeed441373 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:10.550060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 179/356] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:10.550060 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a1b8d-4e3f-4da9-8bed-4dbeed441373 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:10.581249 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfc361-33b7-44a7-8884-a17c428e84fe None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:10.634683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ae9b6-02f0-4e4f-a07d-5f4452b1fedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:10.635387 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ae9b6-02f0-4e4f-a07d-5f4452b1fedd None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:10.635668 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ae9b6-02f0-4e4f-a07d-5f4452b1fedd None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:10.635944 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ae9b6-02f0-4e4f-a07d-5f4452b1fedd None admin] PATH_INFO: `/v3/groups/b04d1b4bd17f4e4183004cd26b418b32` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:10.645054 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ae9b6-02f0-4e4f-a07d-5f4452b1fedd None admin] RBAC: Authorizing `identity:get_group(group_id=b04d1b4bd17f4e4183004cd26b418b32)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:10.646689 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ae9b6-02f0-4e4f-a07d-5f4452b1fedd None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:10.648897 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 178/357] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:10 2022] GET /identity/v3/groups/b04d1b4bd17f4e4183004cd26b418b32 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:10.649315 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ae9b6-02f0-4e4f-a07d-5f4452b1fedd None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:10.690009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:10.695940 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a1b8d-4e3f-4da9-8bed-4dbeed441373 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:10.721926 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:10.736313 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67ad8c-c438-485a-8c6e-3ca9e76edb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:10.736973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67ad8c-c438-485a-8c6e-3ca9e76edb29 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:10.737855 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67ad8c-c438-485a-8c6e-3ca9e76edb29 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:10.738135 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67ad8c-c438-485a-8c6e-3ca9e76edb29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:10.775031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ae9b6-02f0-4e4f-a07d-5f4452b1fedd None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:10.815742 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff724d3-d766-44ce-8474-a82a47df9fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:10.816358 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff724d3-d766-44ce-8474-a82a47df9fa1 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:10.816641 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff724d3-d766-44ce-8474-a82a47df9fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:10.816911 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff724d3-d766-44ce-8474-a82a47df9fa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:10.817803 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff724d3-d766-44ce-8474-a82a47df9fa1 None admin] RBAC: Adding query filter params (role.id=9d0c3738e3c94c5db4b0766c5f44fb11, user.id=30aae00aa19a44aea0255be1ea0e308c, scope.system=all) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:10.818115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff724d3-d766-44ce-8474-a82a47df9fa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:10.820435 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff724d3-d766-44ce-8474-a82a47df9fa1 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:10.820890 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67ad8c-c438-485a-8c6e-3ca9e76edb29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:10.822541 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67ad8c-c438-485a-8c6e-3ca9e76edb29 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:10.834362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 179/358] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Aug 18 21:01:10 2022] GET /identity/v3/role_assignments?user.id=30aae00aa19a44aea0255be1ea0e308c&scope.system=all&role.id=9d0c3738e3c94c5db4b0766c5f44fb11 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:10.835214 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff724d3-d766-44ce-8474-a82a47df9fa1 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:10.963327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:10.972756 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 180/359] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:10.974088 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71356a36-4fc6-4ca8-b18a-445c631ae9cc None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:10.974377 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71356a36-4fc6-4ca8-b18a-445c631ae9cc None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:10.974652 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71356a36-4fc6-4ca8-b18a-445c631ae9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:10.984774 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff724d3-d766-44ce-8474-a82a47df9fa1 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:10.996598 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-71356a36-4fc6-4ca8-b18a-445c631ae9cc None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:10.997862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-71356a36-4fc6-4ca8-b18a-445c631ae9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:11.023794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:11.034505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9b49c-e621-43f5-a305-e5c1afb2a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:11.035052 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9b49c-e621-43f5-a305-e5c1afb2a761 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:11.035378 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9b49c-e621-43f5-a305-e5c1afb2a761 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:11.035654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9b49c-e621-43f5-a305-e5c1afb2a761 None admin] PATH_INFO: `/v3/groups/b04d1b4bd17f4e4183004cd26b418b32` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:11.036876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9b49c-e621-43f5-a305-e5c1afb2a761 None admin] RBAC: Authorizing `identity:get_group(group_id=b04d1b4bd17f4e4183004cd26b418b32)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:11.038369 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9b49c-e621-43f5-a305-e5c1afb2a761 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:11.041335 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 180/360] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:10 2022] GET /identity/v3/groups/b04d1b4bd17f4e4183004cd26b418b32 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:11.042130 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9b49c-e621-43f5-a305-e5c1afb2a761 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:11.096336 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 181/361] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:11.098051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5ed9-5ee5-48cf-b604-38275940d4ba None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:11.098541 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5ed9-5ee5-48cf-b604-38275940d4ba None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:11.099033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5ed9-5ee5-48cf-b604-38275940d4ba None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:11.100517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 182/362] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:11.101398 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f5ed9-5ee5-48cf-b604-38275940d4ba None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:11.177512 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9b49c-e621-43f5-a305-e5c1afb2a761 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:11.219804 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce3b49-3a52-477a-8201-f4ea36e1f9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:11.220569 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce3b49-3a52-477a-8201-f4ea36e1f9e1 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:11.220842 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce3b49-3a52-477a-8201-f4ea36e1f9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:11.221452 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce3b49-3a52-477a-8201-f4ea36e1f9e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:11.222178 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce3b49-3a52-477a-8201-f4ea36e1f9e1 None admin] RBAC: Adding query filter params (group.id=b04d1b4bd17f4e4183004cd26b418b32, role.id=70cebcd047db4003b7016de5c93cab80, scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:11.222757 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce3b49-3a52-477a-8201-f4ea36e1f9e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:11.224740 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce3b49-3a52-477a-8201-f4ea36e1f9e1 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:11.231959 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 181/363] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Aug 18 21:01:11 2022] GET /identity/v3/role_assignments?group.id=b04d1b4bd17f4e4183004cd26b418b32&scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412&role.id=70cebcd047db4003b7016de5c93cab80 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:11.232524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce3b49-3a52-477a-8201-f4ea36e1f9e1 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:11.233721 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f5ed9-5ee5-48cf-b604-38275940d4ba None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:11.267767 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:11.293280 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c16c3-945d-46c3-8725-53f4eaeb5dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:11.293850 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c16c3-945d-46c3-8725-53f4eaeb5dba None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:11.294136 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c16c3-945d-46c3-8725-53f4eaeb5dba None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:11.294417 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c16c3-945d-46c3-8725-53f4eaeb5dba None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:11.300252 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c16c3-945d-46c3-8725-53f4eaeb5dba None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:11.301729 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c16c3-945d-46c3-8725-53f4eaeb5dba None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:11.303778 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 183/364] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:11 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:11.306388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16647b18-5c85-4f22-9376-f5328b581081 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:11.306664 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16647b18-5c85-4f22-9376-f5328b581081 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:11.306930 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16647b18-5c85-4f22-9376-f5328b581081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:11.329921 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-16647b18-5c85-4f22-9376-f5328b581081 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:11.331140 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-16647b18-5c85-4f22-9376-f5328b581081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:11.383085 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:11.392195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce3b49-3a52-477a-8201-f4ea36e1f9e1 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:11.415820 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 184/365] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:11.416831 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16647b18-5c85-4f22-9376-f5328b581081 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:11.469072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c96eb4-b6fb-4b72-9db2-adce21ecd406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:11.470060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c96eb4-b6fb-4b72-9db2-adce21ecd406 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:11.470537 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c96eb4-b6fb-4b72-9db2-adce21ecd406 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:11.471022 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c96eb4-b6fb-4b72-9db2-adce21ecd406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:11.472055 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c96eb4-b6fb-4b72-9db2-adce21ecd406 None admin] RBAC: Adding query filter params (group.id=b04d1b4bd17f4e4183004cd26b418b32, role.id=5d73f21ba2e940f38026b109b9c9e10e, scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:11.472564 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c96eb4-b6fb-4b72-9db2-adce21ecd406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:11.474647 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c96eb4-b6fb-4b72-9db2-adce21ecd406 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:11.491303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 182/366] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Aug 18 21:01:11 2022] GET /identity/v3/role_assignments?group.id=b04d1b4bd17f4e4183004cd26b418b32&scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412&role.id=5d73f21ba2e940f38026b109b9c9e10e => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:11.491303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c96eb4-b6fb-4b72-9db2-adce21ecd406 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:11.546854 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16647b18-5c85-4f22-9376-f5328b581081 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:11.593172 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fa4c5-5086-49d7-8365-b3cefb7f41e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:11.593817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fa4c5-5086-49d7-8365-b3cefb7f41e3 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:11.594099 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fa4c5-5086-49d7-8365-b3cefb7f41e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:11.594439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fa4c5-5086-49d7-8365-b3cefb7f41e3 None admin] PATH_INFO: `/v3/groups/b04d1b4bd17f4e4183004cd26b418b32` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:11.595590 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fa4c5-5086-49d7-8365-b3cefb7f41e3 None admin] RBAC: Authorizing `identity:get_group(group_id=b04d1b4bd17f4e4183004cd26b418b32)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:11.597046 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fa4c5-5086-49d7-8365-b3cefb7f41e3 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:11.603094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 185/367] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:11 2022] GET /identity/v3/groups/b04d1b4bd17f4e4183004cd26b418b32 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:11.612418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fa4c5-5086-49d7-8365-b3cefb7f41e3 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:11.629296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:11.643671 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:11.667507 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c96eb4-b6fb-4b72-9db2-adce21ecd406 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:11.737504 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2236d-a42e-464c-b3a4-7cc4f18b1b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:11.738156 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2236d-a42e-464c-b3a4-7cc4f18b1b03 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:11.738464 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2236d-a42e-464c-b3a4-7cc4f18b1b03 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:11.738712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2236d-a42e-464c-b3a4-7cc4f18b1b03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:11.756590 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2236d-a42e-464c-b3a4-7cc4f18b1b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-f9f2236d-a42e-464c-b3a4-7cc4f18b1b03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:11.762159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:11.763045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:11.766407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:11.766407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:11.766407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:11.766407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:11.766407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:11.766407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:11.766407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:11.766407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:11.766407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:11.766407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:11.766407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:01:11.766407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:11.768528 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 183/368] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:01:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:11.770663 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fa4c5-5086-49d7-8365-b3cefb7f41e3 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:11.776924 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2236d-a42e-464c-b3a4-7cc4f18b1b03 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:11.810921 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce91dc-1b89-4177-8aa7-e8a481fdbab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:11.811728 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce91dc-1b89-4177-8aa7-e8a481fdbab4 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:11.812016 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce91dc-1b89-4177-8aa7-e8a481fdbab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:11.812289 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce91dc-1b89-4177-8aa7-e8a481fdbab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:11.813015 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce91dc-1b89-4177-8aa7-e8a481fdbab4 None admin] RBAC: Adding query filter params (group.id=b04d1b4bd17f4e4183004cd26b418b32, role.id=70cebcd047db4003b7016de5c93cab80, scope.project.id=59b28d193e75472297193587da13dcc8) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:11.813326 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce91dc-1b89-4177-8aa7-e8a481fdbab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:11.814922 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce91dc-1b89-4177-8aa7-e8a481fdbab4 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:11.821174 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 186/369] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Aug 18 21:01:11 2022] GET /identity/v3/role_assignments?group.id=b04d1b4bd17f4e4183004cd26b418b32&scope.project.id=59b28d193e75472297193587da13dcc8&role.id=70cebcd047db4003b7016de5c93cab80 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:11.822006 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce91dc-1b89-4177-8aa7-e8a481fdbab4 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:11.924216 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2236d-a42e-464c-b3a4-7cc4f18b1b03 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:11.946488 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:11.973441 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a1d78-0d74-46ac-a8ad-7fd6c5d0124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:11.974457 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a1d78-0d74-46ac-a8ad-7fd6c5d0124c None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:11.975005 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a1d78-0d74-46ac-a8ad-7fd6c5d0124c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:11.975508 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a1d78-0d74-46ac-a8ad-7fd6c5d0124c None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:11.976415 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a1d78-0d74-46ac-a8ad-7fd6c5d0124c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:11.976953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a1d78-0d74-46ac-a8ad-7fd6c5d0124c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:11.977066 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce91dc-1b89-4177-8aa7-e8a481fdbab4 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:11.978671 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a1d78-0d74-46ac-a8ad-7fd6c5d0124c None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:11.992241 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 184/370] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:12.004369 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a1d78-0d74-46ac-a8ad-7fd6c5d0124c None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:12.009346 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:12.024832 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9fee1-0334-4ba1-b00d-c90cc1e0bff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:12.025483 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9fee1-0334-4ba1-b00d-c90cc1e0bff5 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:12.025764 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9fee1-0334-4ba1-b00d-c90cc1e0bff5 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:12.026037 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9fee1-0334-4ba1-b00d-c90cc1e0bff5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:12.048103 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9fee1-0334-4ba1-b00d-c90cc1e0bff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-71f9fee1-0334-4ba1-b00d-c90cc1e0bff5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:12.054082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:12.055068 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:12.055907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:12.055907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:12.055907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:12.055907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:12.055907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:12.055907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:12.055907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:12.055907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:12.055907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:12.055907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:12.055907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:01:12.055907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:12.055907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 187/371] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:01:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:12.063354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9fee1-0334-4ba1-b00d-c90cc1e0bff5 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:12.136522 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a1d78-0d74-46ac-a8ad-7fd6c5d0124c None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:12.173048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f155a74-b562-4bf7-b6ee-dff71a5f61ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:12.174075 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f155a74-b562-4bf7-b6ee-dff71a5f61ea None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:12.174588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f155a74-b562-4bf7-b6ee-dff71a5f61ea None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:12.175067 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f155a74-b562-4bf7-b6ee-dff71a5f61ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:12.186318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9fee1-0334-4ba1-b00d-c90cc1e0bff5 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:12.222232 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527e589-a3c1-418a-bd4e-d3f111cf63e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:12.222716 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527e589-a3c1-418a-bd4e-d3f111cf63e5 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:12.222999 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527e589-a3c1-418a-bd4e-d3f111cf63e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:12.223287 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527e589-a3c1-418a-bd4e-d3f111cf63e5 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:12.224150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527e589-a3c1-418a-bd4e-d3f111cf63e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:12.224461 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527e589-a3c1-418a-bd4e-d3f111cf63e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:12.226401 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527e589-a3c1-418a-bd4e-d3f111cf63e5 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:12.235445 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 188/372] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:12.241640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527e589-a3c1-418a-bd4e-d3f111cf63e5 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:12.251086 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:12.262696 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f155a74-b562-4bf7-b6ee-dff71a5f61ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:12.264833 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f155a74-b562-4bf7-b6ee-dff71a5f61ea None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:12.267982 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:12.355716 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527e589-a3c1-418a-bd4e-d3f111cf63e5 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:12.378475 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 185/373] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:12.392336 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f155a74-b562-4bf7-b6ee-dff71a5f61ea None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:12.400843 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44419d-141c-4fb0-94d5-00010c8ce659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:12.401155 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44419d-141c-4fb0-94d5-00010c8ce659 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:12.401438 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44419d-141c-4fb0-94d5-00010c8ce659 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:12.401716 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44419d-141c-4fb0-94d5-00010c8ce659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:12.479287 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44419d-141c-4fb0-94d5-00010c8ce659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:12.479287 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44419d-141c-4fb0-94d5-00010c8ce659 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:12.483621 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:12.560189 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f155a74-b562-4bf7-b6ee-dff71a5f61ea None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:12.564408 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:12.634400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36248e20-8c21-444b-9c26-efd795b599e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:12.634958 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248e20-8c21-444b-9c26-efd795b599e8 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:12.635239 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248e20-8c21-444b-9c26-efd795b599e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:12.635537 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248e20-8c21-444b-9c26-efd795b599e8 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:12.637080 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36248e20-8c21-444b-9c26-efd795b599e8 None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:12.638683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36248e20-8c21-444b-9c26-efd795b599e8 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:12.644123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 186/374] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:12 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:12.651042 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36248e20-8c21-444b-9c26-efd795b599e8 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:12.659500 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 189/375] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 21:01:12.669379 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44419d-141c-4fb0-94d5-00010c8ce659 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:12.781178 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36248e20-8c21-444b-9c26-efd795b599e8 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:12.811005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44419d-141c-4fb0-94d5-00010c8ce659 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:12.823741 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:12.825130 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8643a-6e43-4362-a9cc-2e23972af423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:12.825773 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8643a-6e43-4362-a9cc-2e23972af423 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:12.826054 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8643a-6e43-4362-a9cc-2e23972af423 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:12.826329 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8643a-6e43-4362-a9cc-2e23972af423 None admin] PATH_INFO: `/v3/groups/b04d1b4bd17f4e4183004cd26b418b32` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:12.827527 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8643a-6e43-4362-a9cc-2e23972af423 None admin] RBAC: Authorizing `identity:get_group(group_id=b04d1b4bd17f4e4183004cd26b418b32)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:12.829167 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8643a-6e43-4362-a9cc-2e23972af423 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:12.830777 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 187/376] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:12 2022] GET /identity/v3/groups/b04d1b4bd17f4e4183004cd26b418b32 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:12.836760 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8643a-6e43-4362-a9cc-2e23972af423 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:12.849886 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f144f0-571c-4931-b001-da9d37a97c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:12.850845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f144f0-571c-4931-b001-da9d37a97c6b None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:12.851406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f144f0-571c-4931-b001-da9d37a97c6b None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:12.851874 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f144f0-571c-4931-b001-da9d37a97c6b None admin] PATH_INFO: `/v3/projects/9fde81811a6d48dea0f606eb2c250dc9` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:12.853210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f144f0-571c-4931-b001-da9d37a97c6b None admin] RBAC: Authorizing `identity:get_project(project_id=9fde81811a6d48dea0f606eb2c250dc9)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:12.854881 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f144f0-571c-4931-b001-da9d37a97c6b None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:12.857179 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 190/377] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:12 2022] GET /identity/v3/projects/9fde81811a6d48dea0f606eb2c250dc9 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:12.864397 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f144f0-571c-4931-b001-da9d37a97c6b None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:12.929988 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:12.980362 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f144f0-571c-4931-b001-da9d37a97c6b None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:13.022236 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8643a-6e43-4362-a9cc-2e23972af423 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:13.044232 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c771ed8-7013-4489-ae45-e34d949ae028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:13.044871 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c771ed8-7013-4489-ae45-e34d949ae028 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:13.045150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c771ed8-7013-4489-ae45-e34d949ae028 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:13.045421 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c771ed8-7013-4489-ae45-e34d949ae028 None admin] PATH_INFO: `/v3/groups/f5f46016e2de4180b271346dab1a36bf` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:13.061136 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c771ed8-7013-4489-ae45-e34d949ae028 None admin] RBAC: Authorizing `identity:get_group(group_id=f5f46016e2de4180b271346dab1a36bf)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:13.062736 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c771ed8-7013-4489-ae45-e34d949ae028 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:13.064375 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b79c22-199b-4e8b-a99b-b2154f96d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:13.065054 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b79c22-199b-4e8b-a99b-b2154f96d384 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:13.065333 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b79c22-199b-4e8b-a99b-b2154f96d384 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:13.065433 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 191/378] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:12 2022] GET /identity/v3/groups/f5f46016e2de4180b271346dab1a36bf => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:13.065610 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b79c22-199b-4e8b-a99b-b2154f96d384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:13.066407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b79c22-199b-4e8b-a99b-b2154f96d384 None admin] RBAC: Adding query filter params (group.id=b04d1b4bd17f4e4183004cd26b418b32, role.id=5d73f21ba2e940f38026b109b9c9e10e, scope.project.id=59b28d193e75472297193587da13dcc8) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:13.066721 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b79c22-199b-4e8b-a99b-b2154f96d384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:13.068317 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b79c22-199b-4e8b-a99b-b2154f96d384 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:13.070339 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c771ed8-7013-4489-ae45-e34d949ae028 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:13.077644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 188/379] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Aug 18 21:01:12 2022] GET /identity/v3/role_assignments?group.id=b04d1b4bd17f4e4183004cd26b418b32&scope.project.id=59b28d193e75472297193587da13dcc8&role.id=5d73f21ba2e940f38026b109b9c9e10e => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:13.121236 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:13.202282 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c771ed8-7013-4489-ae45-e34d949ae028 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:13.242720 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9c357-4fde-4ea7-81fe-aacb116c1b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:13.243623 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9c357-4fde-4ea7-81fe-aacb116c1b65 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:13.243904 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9c357-4fde-4ea7-81fe-aacb116c1b65 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:13.244171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9c357-4fde-4ea7-81fe-aacb116c1b65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:13.244898 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9c357-4fde-4ea7-81fe-aacb116c1b65 None admin] RBAC: Adding query filter params (group.id=f5f46016e2de4180b271346dab1a36bf, role.id=49c7d15532d94cafac420a6bcf8574ad, scope.project.id=9fde81811a6d48dea0f606eb2c250dc9) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:13.245205 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9c357-4fde-4ea7-81fe-aacb116c1b65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:13.246639 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9c357-4fde-4ea7-81fe-aacb116c1b65 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:13.255641 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 192/380] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Aug 18 21:01:13 2022] GET /identity/v3/role_assignments?group.id=f5f46016e2de4180b271346dab1a36bf&scope.project.id=9fde81811a6d48dea0f606eb2c250dc9&role.id=49c7d15532d94cafac420a6bcf8574ad => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:14.442771 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e101c-809a-4006-a167-57676012d0b1 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:14.443332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e101c-809a-4006-a167-57676012d0b1 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:14.443332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e101c-809a-4006-a167-57676012d0b1 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:14.445584 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 189/381] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:14.451914 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265413b-1892-4c7f-aeb4-867a59b05185 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:14.452449 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265413b-1892-4c7f-aeb4-867a59b05185 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:14.452683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265413b-1892-4c7f-aeb4-867a59b05185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:14.480466 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-b265413b-1892-4c7f-aeb4-867a59b05185 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:14.481711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-b265413b-1892-4c7f-aeb4-867a59b05185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:14.559239 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 193/382] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:14.700807 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2fff7-b727-4c1b-9aec-3e30bf126ef6 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:14.701420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2fff7-b727-4c1b-9aec-3e30bf126ef6 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:14.701898 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2fff7-b727-4c1b-9aec-3e30bf126ef6 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:14.703712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 190/383] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:14.710106 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15248255-a11d-4394-9d43-8d8f2a909e70 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:14.710628 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15248255-a11d-4394-9d43-8d8f2a909e70 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:14.711097 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15248255-a11d-4394-9d43-8d8f2a909e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:14.731091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7865b-6a29-4c6d-8485-072162a37dc5 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:14.731707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7865b-6a29-4c6d-8485-072162a37dc5 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:14.732200 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7865b-6a29-4c6d-8485-072162a37dc5 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:14.733974 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 191/384] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:14.736248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-15248255-a11d-4394-9d43-8d8f2a909e70 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:14.737442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-15248255-a11d-4394-9d43-8d8f2a909e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:14.739841 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a15c9-b22c-483c-b5ab-191ae8fdd2ef None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:14.740396 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a15c9-b22c-483c-b5ab-191ae8fdd2ef None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:14.740869 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a15c9-b22c-483c-b5ab-191ae8fdd2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:14.761607 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-2d3a15c9-b22c-483c-b5ab-191ae8fdd2ef None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:14.763117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-2d3a15c9-b22c-483c-b5ab-191ae8fdd2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:14.782647 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:14.855701 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 192/385] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:14.866057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 194/386] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:15.083882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a15c9-b22c-483c-b5ab-191ae8fdd2ef None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:15.127747 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:15.216045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a15c9-b22c-483c-b5ab-191ae8fdd2ef None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:15.252432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15248255-a11d-4394-9d43-8d8f2a909e70 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:15.254448 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfab8c2-cf35-4490-a4d0-0f4bfc8983a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:15.255140 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfab8c2-cf35-4490-a4d0-0f4bfc8983a0 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:15.255452 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfab8c2-cf35-4490-a4d0-0f4bfc8983a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:15.255723 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfab8c2-cf35-4490-a4d0-0f4bfc8983a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:15.267088 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfab8c2-cf35-4490-a4d0-0f4bfc8983a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-2cfab8c2-cf35-4490-a4d0-0f4bfc8983a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:15.271983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:15.272850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:15.274654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:15.274654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:15.274654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:15.274654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:15.274654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:15.274654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:15.274654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:15.274654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:15.274654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:15.274654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:15.274654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:15.274654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:15.274654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 193/387] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:15.278843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfab8c2-cf35-4490-a4d0-0f4bfc8983a0 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:15.387889 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15248255-a11d-4394-9d43-8d8f2a909e70 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:15.424190 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d89fe-f4e5-4ab1-a865-3bbe46b24f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:15.424966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d89fe-f4e5-4ab1-a865-3bbe46b24f14 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:15.425339 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d89fe-f4e5-4ab1-a865-3bbe46b24f14 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:15.425750 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d89fe-f4e5-4ab1-a865-3bbe46b24f14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:15.436217 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d89fe-f4e5-4ab1-a865-3bbe46b24f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-078d89fe-f4e5-4ab1-a865-3bbe46b24f14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:15.441147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:15.442209 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:15.443242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:15.443242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:15.443242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:15.443242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:15.443242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:15.443242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:15.443242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:15.443242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:15.443242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:15.443242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:15.443242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:15.443242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:15.445788 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 195/388] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:15.452825 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d89fe-f4e5-4ab1-a865-3bbe46b24f14 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:15.453759 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:15.465433 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfab8c2-cf35-4490-a4d0-0f4bfc8983a0 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:15.496658 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:15.533154 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a3793-72b3-4313-8f62-952444749bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:15.533759 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a3793-72b3-4313-8f62-952444749bf4 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:15.534035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a3793-72b3-4313-8f62-952444749bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:15.534304 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a3793-72b3-4313-8f62-952444749bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:15.534960 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a3793-72b3-4313-8f62-952444749bf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:15.535302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a3793-72b3-4313-8f62-952444749bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:15.536662 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a3793-72b3-4313-8f62-952444749bf4 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:15.551195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 194/389] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:01:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:15.552491 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a3793-72b3-4313-8f62-952444749bf4 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:15.594934 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d89fe-f4e5-4ab1-a865-3bbe46b24f14 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:15.630283 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b001f-c84f-465b-9168-58d95657d6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:15.631512 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b001f-c84f-465b-9168-58d95657d6e9 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:15.631857 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b001f-c84f-465b-9168-58d95657d6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:15.632119 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b001f-c84f-465b-9168-58d95657d6e9 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:15.632778 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b001f-c84f-465b-9168-58d95657d6e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:15.633078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b001f-c84f-465b-9168-58d95657d6e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:15.634448 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b001f-c84f-465b-9168-58d95657d6e9 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:15.643688 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 196/390] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:01:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:15.644460 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b001f-c84f-465b-9168-58d95657d6e9 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:15.668710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a3793-72b3-4313-8f62-952444749bf4 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:15.704918 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6111d6-d474-499c-b3ac-f253e611e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:15.705552 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6111d6-d474-499c-b3ac-f253e611e7dd None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:15.705888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6111d6-d474-499c-b3ac-f253e611e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:15.706161 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6111d6-d474-499c-b3ac-f253e611e7dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:15.718080 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6111d6-d474-499c-b3ac-f253e611e7dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-7d6111d6-d474-499c-b3ac-f253e611e7dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:15.723594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:15.724465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:15.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:15.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:15.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:15.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:15.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:15.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:15.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:15.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:15.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:15.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:15.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:01:15.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:15.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 195/391] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:01:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:15.726949 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6111d6-d474-499c-b3ac-f253e611e7dd None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:15.736275 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:15.748393 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:15.752920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b001f-c84f-465b-9168-58d95657d6e9 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:15.789268 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c7a80-a26c-45c2-8d8d-780107f30623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:15.790067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c7a80-a26c-45c2-8d8d-780107f30623 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:15.790197 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c7a80-a26c-45c2-8d8d-780107f30623 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:15.790424 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c7a80-a26c-45c2-8d8d-780107f30623 None admin] PATH_INFO: `/v3/groups/b04d1b4bd17f4e4183004cd26b418b32` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:15.791560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c7a80-a26c-45c2-8d8d-780107f30623 None admin] RBAC: Authorizing `identity:get_group(group_id=b04d1b4bd17f4e4183004cd26b418b32)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:15.793092 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c7a80-a26c-45c2-8d8d-780107f30623 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:15.798954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 197/392] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:15 2022] GET /identity/v3/groups/b04d1b4bd17f4e4183004cd26b418b32 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:15.798954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c7a80-a26c-45c2-8d8d-780107f30623 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:15.848604 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6111d6-d474-499c-b3ac-f253e611e7dd None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:15.887181 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e0383-c5a9-462e-9d32-9780f67cf3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:15.888071 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0383-c5a9-462e-9d32-9780f67cf3b2 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:15.888580 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0383-c5a9-462e-9d32-9780f67cf3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:15.888988 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0383-c5a9-462e-9d32-9780f67cf3b2 None admin] PATH_INFO: `/v3/groups/b04d1b4bd17f4e4183004cd26b418b32` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:15.890335 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e0383-c5a9-462e-9d32-9780f67cf3b2 None admin] RBAC: Authorizing `identity:get_group(group_id=b04d1b4bd17f4e4183004cd26b418b32)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:15.892342 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e0383-c5a9-462e-9d32-9780f67cf3b2 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:15.894111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 196/393] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:15 2022] GET /identity/v3/groups/b04d1b4bd17f4e4183004cd26b418b32 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:15.898660 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c7a80-a26c-45c2-8d8d-780107f30623 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:15.899889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e0383-c5a9-462e-9d32-9780f67cf3b2 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:15.934430 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34cc70-914c-4f4c-aeaf-11ccbdd12069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:15.935298 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34cc70-914c-4f4c-aeaf-11ccbdd12069 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:15.935431 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34cc70-914c-4f4c-aeaf-11ccbdd12069 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:15.935598 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34cc70-914c-4f4c-aeaf-11ccbdd12069 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:15.936296 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34cc70-914c-4f4c-aeaf-11ccbdd12069 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:15.936571 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34cc70-914c-4f4c-aeaf-11ccbdd12069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:15.937923 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34cc70-914c-4f4c-aeaf-11ccbdd12069 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:15.946118 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 198/394] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:15.946929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34cc70-914c-4f4c-aeaf-11ccbdd12069 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:15.967598 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:15.996935 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:16.015345 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e0383-c5a9-462e-9d32-9780f67cf3b2 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:16.055823 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff385d-19b2-479a-8a56-65173a7f57a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:16.056740 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff385d-19b2-479a-8a56-65173a7f57a1 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:16.057157 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff385d-19b2-479a-8a56-65173a7f57a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:16.057564 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff385d-19b2-479a-8a56-65173a7f57a1 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:16.059057 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff385d-19b2-479a-8a56-65173a7f57a1 None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:16.060649 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff385d-19b2-479a-8a56-65173a7f57a1 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:16.061723 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34cc70-914c-4f4c-aeaf-11ccbdd12069 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:16.062574 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 197/395] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:15 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:16.069049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff385d-19b2-479a-8a56-65173a7f57a1 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:16.100343 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15edf9-f33b-4dfb-a143-e2bead3e0e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:16.101077 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15edf9-f33b-4dfb-a143-e2bead3e0e85 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:16.101296 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15edf9-f33b-4dfb-a143-e2bead3e0e85 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:16.101620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15edf9-f33b-4dfb-a143-e2bead3e0e85 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:16.102796 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15edf9-f33b-4dfb-a143-e2bead3e0e85 None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:16.104698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15edf9-f33b-4dfb-a143-e2bead3e0e85 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:16.111662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 199/396] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:15 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:16.111662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15edf9-f33b-4dfb-a143-e2bead3e0e85 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:16.190108 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff385d-19b2-479a-8a56-65173a7f57a1 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:16.198501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:16.219510 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15edf9-f33b-4dfb-a143-e2bead3e0e85 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:16.226669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0d878-9008-4fdb-b343-85cf7138f7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:16.227747 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0d878-9008-4fdb-b343-85cf7138f7d3 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:16.228029 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0d878-9008-4fdb-b343-85cf7138f7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:16.228304 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0d878-9008-4fdb-b343-85cf7138f7d3 None admin] PATH_INFO: `/v3/groups/b04d1b4bd17f4e4183004cd26b418b32` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:16.229751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0d878-9008-4fdb-b343-85cf7138f7d3 None admin] RBAC: Authorizing `identity:get_group(group_id=b04d1b4bd17f4e4183004cd26b418b32)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:16.231538 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0d878-9008-4fdb-b343-85cf7138f7d3 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:16.237804 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 198/397] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:16 2022] GET /identity/v3/groups/b04d1b4bd17f4e4183004cd26b418b32 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:16.237804 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0d878-9008-4fdb-b343-85cf7138f7d3 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:16.258764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:16.266326 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6704ef-e79a-4188-bb72-e71204882746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:16.266986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6704ef-e79a-4188-bb72-e71204882746 None admin] REQUEST_METHOD: `PUT` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:16.267323 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6704ef-e79a-4188-bb72-e71204882746 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:16.267601 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6704ef-e79a-4188-bb72-e71204882746 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412/groups/b04d1b4bd17f4e4183004cd26b418b32/roles/70cebcd047db4003b7016de5c93cab80` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:16.269484 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6704ef-e79a-4188-bb72-e71204882746 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa7e7bc5516444f2be8b5dae7b0c4412, group_id=b04d1b4bd17f4e4183004cd26b418b32, role_id=70cebcd047db4003b7016de5c93cab80)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:16.270908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6704ef-e79a-4188-bb72-e71204882746 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:16.283306 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 200/398] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Aug 18 21:01:16 2022] PUT /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412/groups/b04d1b4bd17f4e4183004cd26b418b32/roles/70cebcd047db4003b7016de5c93cab80 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:16.284512 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25596afd-c4e8-43e9-b339-54650d94dbf9 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:16.284797 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25596afd-c4e8-43e9-b339-54650d94dbf9 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:16.285067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25596afd-c4e8-43e9-b339-54650d94dbf9 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:16.286296 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 201/399] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:16.287036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25596afd-c4e8-43e9-b339-54650d94dbf9 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:16.362209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0d878-9008-4fdb-b343-85cf7138f7d3 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:16.404276 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdcc58-9698-49ae-aae3-dded07dc290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:16.404946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdcc58-9698-49ae-aae3-dded07dc290a None admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:16.405230 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdcc58-9698-49ae-aae3-dded07dc290a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:16.405505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdcc58-9698-49ae-aae3-dded07dc290a None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8/groups/b04d1b4bd17f4e4183004cd26b418b32/roles/70cebcd047db4003b7016de5c93cab80` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:16.407555 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdcc58-9698-49ae-aae3-dded07dc290a None admin] RBAC: Authorizing `identity:create_grant(project_id=59b28d193e75472297193587da13dcc8, group_id=b04d1b4bd17f4e4183004cd26b418b32, role_id=70cebcd047db4003b7016de5c93cab80)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:16.409038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdcc58-9698-49ae-aae3-dded07dc290a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:16.420377 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25596afd-c4e8-43e9-b339-54650d94dbf9 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:16.423391 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 199/400] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Aug 18 21:01:16 2022] PUT /identity/v3/projects/59b28d193e75472297193587da13dcc8/groups/b04d1b4bd17f4e4183004cd26b418b32/roles/70cebcd047db4003b7016de5c93cab80 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:16.424442 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80cf65-03ea-4296-9074-39fba5ea1405 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:16.424730 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80cf65-03ea-4296-9074-39fba5ea1405 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:16.425005 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80cf65-03ea-4296-9074-39fba5ea1405 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:16.426438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 200/401] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:16.429367 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35023-12d4-48fb-9fde-e5272c6c6b8e None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:16.429997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35023-12d4-48fb-9fde-e5272c6c6b8e None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:16.430465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35023-12d4-48fb-9fde-e5272c6c6b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:16.452119 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-02e35023-12d4-48fb-9fde-e5272c6c6b8e None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:16.453811 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-02e35023-12d4-48fb-9fde-e5272c6c6b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:16.473106 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5d6c0-6839-41a1-9541-91829366017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:16.473958 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5d6c0-6839-41a1-9541-91829366017c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:16.474307 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5d6c0-6839-41a1-9541-91829366017c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:16.474776 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5d6c0-6839-41a1-9541-91829366017c None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:16.477524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5d6c0-6839-41a1-9541-91829366017c None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:16.480007 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5d6c0-6839-41a1-9541-91829366017c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:16.481966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 202/402] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:16 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:16.483309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b964c-9c9d-4177-b4d9-51de3af76f0f None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:16.483457 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b964c-9c9d-4177-b4d9-51de3af76f0f None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:16.483937 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b964c-9c9d-4177-b4d9-51de3af76f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:16.505208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-af4b964c-9c9d-4177-b4d9-51de3af76f0f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:16.506980 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-af4b964c-9c9d-4177-b4d9-51de3af76f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:16.512501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:16.544132 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 201/403] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:16.545855 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e35023-12d4-48fb-9fde-e5272c6c6b8e None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:16.561166 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:16.592130 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 203/404] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:16.701559 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e35023-12d4-48fb-9fde-e5272c6c6b8e None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:16.739956 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e8a4f-cd2f-46e1-b494-af8dbe59529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:16.741151 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e8a4f-cd2f-46e1-b494-af8dbe59529f None admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:16.741436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e8a4f-cd2f-46e1-b494-af8dbe59529f None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:16.741762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e8a4f-cd2f-46e1-b494-af8dbe59529f None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412/groups/b04d1b4bd17f4e4183004cd26b418b32/roles/5d73f21ba2e940f38026b109b9c9e10e` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:16.744762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e8a4f-cd2f-46e1-b494-af8dbe59529f None admin] RBAC: Authorizing `identity:create_grant(project_id=aa7e7bc5516444f2be8b5dae7b0c4412, group_id=b04d1b4bd17f4e4183004cd26b418b32, role_id=5d73f21ba2e940f38026b109b9c9e10e)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:16.746223 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e8a4f-cd2f-46e1-b494-af8dbe59529f None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:16.762428 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 202/405] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Aug 18 21:01:16 2022] PUT /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412/groups/b04d1b4bd17f4e4183004cd26b418b32/roles/5d73f21ba2e940f38026b109b9c9e10e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:16.956848 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b964c-9c9d-4177-b4d9-51de3af76f0f None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:16.995640 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e8a4f-cd2f-46e1-b494-af8dbe59529f None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:17.106723 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:17.114532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b964c-9c9d-4177-b4d9-51de3af76f0f None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:17.154356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e8a4f-cd2f-46e1-b494-af8dbe59529f None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:17.171409 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda4aee-79ca-4253-891b-99f73373913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:17.172132 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda4aee-79ca-4253-891b-99f73373913c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:17.172413 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda4aee-79ca-4253-891b-99f73373913c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:17.172684 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda4aee-79ca-4253-891b-99f73373913c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:17.181152 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:17.184170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda4aee-79ca-4253-891b-99f73373913c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-2bda4aee-79ca-4253-891b-99f73373913c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:17.188945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:17.190125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:17.191134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:17.191134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:17.191134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:17.191134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:17.191134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:17.191134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:17.191134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:17.191134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:17.191134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:17.191134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:17.191134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:01:17.191134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:17.191993 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 204/406] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:01:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:17.197674 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda4aee-79ca-4253-891b-99f73373913c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:17.242836 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d305f-c6f6-4c72-a698-7036331d5053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:17.243520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d305f-c6f6-4c72-a698-7036331d5053 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:17.243868 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d305f-c6f6-4c72-a698-7036331d5053 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:17.244150 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d305f-c6f6-4c72-a698-7036331d5053 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:17.275870 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d305f-c6f6-4c72-a698-7036331d5053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-206d305f-c6f6-4c72-a698-7036331d5053 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:17.280583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:17.281479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:17.282282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:17.282282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:17.282282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:17.282282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:17.282282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:17.282282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:17.282282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:17.282282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:17.282282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:17.282282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:17.282282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:01:17.282282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:17.284286 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 203/407] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:01:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:17.292222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d305f-c6f6-4c72-a698-7036331d5053 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:17.310067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda4aee-79ca-4253-891b-99f73373913c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:17.346725 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df642f5e-fc18-4bb6-9398-b8433eebcc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:17.347366 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642f5e-fc18-4bb6-9398-b8433eebcc55 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:17.347648 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642f5e-fc18-4bb6-9398-b8433eebcc55 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:17.347917 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642f5e-fc18-4bb6-9398-b8433eebcc55 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:17.348580 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df642f5e-fc18-4bb6-9398-b8433eebcc55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:17.348878 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df642f5e-fc18-4bb6-9398-b8433eebcc55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:17.350831 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df642f5e-fc18-4bb6-9398-b8433eebcc55 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:17.359630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 205/408] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:17.372383 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df642f5e-fc18-4bb6-9398-b8433eebcc55 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:17.471930 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d305f-c6f6-4c72-a698-7036331d5053 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:17.492159 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:17.528149 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:17.536468 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23661bb0-3fc4-40a5-aee8-7a7c7be14a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:17.537067 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661bb0-3fc4-40a5-aee8-7a7c7be14a97 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:17.537358 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661bb0-3fc4-40a5-aee8-7a7c7be14a97 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:17.537637 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661bb0-3fc4-40a5-aee8-7a7c7be14a97 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:17.538304 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23661bb0-3fc4-40a5-aee8-7a7c7be14a97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:17.538613 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23661bb0-3fc4-40a5-aee8-7a7c7be14a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:17.540248 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23661bb0-3fc4-40a5-aee8-7a7c7be14a97 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:17.551245 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 204/409] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:17.556622 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23661bb0-3fc4-40a5-aee8-7a7c7be14a97 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:17.578912 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df642f5e-fc18-4bb6-9398-b8433eebcc55 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:17.647934 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656c044-5c9b-4e3d-a42d-43e2e9338a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:17.648568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656c044-5c9b-4e3d-a42d-43e2e9338a67 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:17.648851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656c044-5c9b-4e3d-a42d-43e2e9338a67 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:17.649134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656c044-5c9b-4e3d-a42d-43e2e9338a67 None admin] PATH_INFO: `/v3/groups/b04d1b4bd17f4e4183004cd26b418b32` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:17.651176 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656c044-5c9b-4e3d-a42d-43e2e9338a67 None admin] RBAC: Authorizing `identity:get_group(group_id=b04d1b4bd17f4e4183004cd26b418b32)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:17.652720 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656c044-5c9b-4e3d-a42d-43e2e9338a67 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:17.654726 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 206/410] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:17 2022] GET /identity/v3/groups/b04d1b4bd17f4e4183004cd26b418b32 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:17.663350 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656c044-5c9b-4e3d-a42d-43e2e9338a67 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:17.816909 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23661bb0-3fc4-40a5-aee8-7a7c7be14a97 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:17.888964 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964d04a-a292-4606-9b09-06e4fa99a1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:17.889609 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964d04a-a292-4606-9b09-06e4fa99a1f9 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:17.889887 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964d04a-a292-4606-9b09-06e4fa99a1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:17.890168 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964d04a-a292-4606-9b09-06e4fa99a1f9 None admin] PATH_INFO: `/v3/groups/f5f46016e2de4180b271346dab1a36bf` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:17.899362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964d04a-a292-4606-9b09-06e4fa99a1f9 None admin] RBAC: Authorizing `identity:get_group(group_id=f5f46016e2de4180b271346dab1a36bf)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:17.899362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964d04a-a292-4606-9b09-06e4fa99a1f9 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:17.902363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656c044-5c9b-4e3d-a42d-43e2e9338a67 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:17.911285 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 205/411] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:17 2022] GET /identity/v3/groups/f5f46016e2de4180b271346dab1a36bf => generated 229 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:17.911285 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964d04a-a292-4606-9b09-06e4fa99a1f9 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:17.997055 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:18.014655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:18.015652 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3b0ed-3592-4d0f-a0cb-eb8f9cb43945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:18.016300 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3b0ed-3592-4d0f-a0cb-eb8f9cb43945 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:18.016583 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3b0ed-3592-4d0f-a0cb-eb8f9cb43945 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:18.016866 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3b0ed-3592-4d0f-a0cb-eb8f9cb43945 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:18.018106 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3b0ed-3592-4d0f-a0cb-eb8f9cb43945 None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:18.019697 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3b0ed-3592-4d0f-a0cb-eb8f9cb43945 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:18.031460 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 207/412] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:17 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:18.032392 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3b0ed-3592-4d0f-a0cb-eb8f9cb43945 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:18.080198 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964d04a-a292-4606-9b09-06e4fa99a1f9 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:18.132222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e122ca-7a3e-45d3-925b-46b2e484b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:18.133292 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e122ca-7a3e-45d3-925b-46b2e484b01e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:18.133578 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e122ca-7a3e-45d3-925b-46b2e484b01e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:18.133901 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e122ca-7a3e-45d3-925b-46b2e484b01e None admin] PATH_INFO: `/v3/projects/9fde81811a6d48dea0f606eb2c250dc9` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:18.135044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e122ca-7a3e-45d3-925b-46b2e484b01e None admin] RBAC: Authorizing `identity:get_project(project_id=9fde81811a6d48dea0f606eb2c250dc9)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:18.137063 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e122ca-7a3e-45d3-925b-46b2e484b01e None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:18.138998 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 206/413] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:17 2022] GET /identity/v3/projects/9fde81811a6d48dea0f606eb2c250dc9 => generated 344 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:18.148269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e122ca-7a3e-45d3-925b-46b2e484b01e None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:18.199115 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3b0ed-3592-4d0f-a0cb-eb8f9cb43945 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:18.244370 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef03ac8-f3e7-43a7-85af-0c6dc2772660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:18.245039 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef03ac8-f3e7-43a7-85af-0c6dc2772660 None admin] REQUEST_METHOD: `PUT` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:18.245320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef03ac8-f3e7-43a7-85af-0c6dc2772660 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:18.245594 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef03ac8-f3e7-43a7-85af-0c6dc2772660 None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8/groups/b04d1b4bd17f4e4183004cd26b418b32/roles/5d73f21ba2e940f38026b109b9c9e10e` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:18.247886 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef03ac8-f3e7-43a7-85af-0c6dc2772660 None admin] RBAC: Authorizing `identity:create_grant(project_id=59b28d193e75472297193587da13dcc8, group_id=b04d1b4bd17f4e4183004cd26b418b32, role_id=5d73f21ba2e940f38026b109b9c9e10e)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:18.249429 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef03ac8-f3e7-43a7-85af-0c6dc2772660 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:18.272211 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 208/414] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Aug 18 21:01:18 2022] PUT /identity/v3/projects/59b28d193e75472297193587da13dcc8/groups/b04d1b4bd17f4e4183004cd26b418b32/roles/5d73f21ba2e940f38026b109b9c9e10e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:18.332531 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e122ca-7a3e-45d3-925b-46b2e484b01e None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:18.367648 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:18.373089 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5324-1322-4074-a3cd-54c13cdd1fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:18.374243 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5324-1322-4074-a3cd-54c13cdd1fdc None admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:18.374786 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5324-1322-4074-a3cd-54c13cdd1fdc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:18.375478 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5324-1322-4074-a3cd-54c13cdd1fdc None admin] PATH_INFO: `/v3/projects/9fde81811a6d48dea0f606eb2c250dc9/groups/f5f46016e2de4180b271346dab1a36bf/roles/49c7d15532d94cafac420a6bcf8574ad` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:18.377509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5324-1322-4074-a3cd-54c13cdd1fdc None admin] RBAC: Authorizing `identity:create_grant(project_id=9fde81811a6d48dea0f606eb2c250dc9, group_id=f5f46016e2de4180b271346dab1a36bf, role_id=49c7d15532d94cafac420a6bcf8574ad)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:18.379039 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5324-1322-4074-a3cd-54c13cdd1fdc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:18.403577 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 207/415] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Aug 18 21:01:18 2022] PUT /identity/v3/projects/9fde81811a6d48dea0f606eb2c250dc9/groups/f5f46016e2de4180b271346dab1a36bf/roles/49c7d15532d94cafac420a6bcf8574ad => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:18.758012 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd33e-e566-418b-8c6c-74d81976e21a None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:18.759036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd33e-e566-418b-8c6c-74d81976e21a None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:18.759541 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd33e-e566-418b-8c6c-74d81976e21a None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:18.761379 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 209/416] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:18.767896 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7effde-6614-4924-b610-f111060420fe None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:18.768788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7effde-6614-4924-b610-f111060420fe None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:18.769280 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7effde-6614-4924-b610-f111060420fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:18.788158 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-bf7effde-6614-4924-b610-f111060420fe None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:18.789705 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-bf7effde-6614-4924-b610-f111060420fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:18.877344 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 208/417] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:19.374796 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd33e-e566-418b-8c6c-74d81976e21a None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:19.417309 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951e980-bc26-463a-9581-8734cf895380 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:19.417622 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951e980-bc26-463a-9581-8734cf895380 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:19.417871 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951e980-bc26-463a-9581-8734cf895380 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:19.419434 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 209/418] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:01:19.420535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a9784-2e8a-4f63-82f9-dcf145238ee0 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:19.420738 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a9784-2e8a-4f63-82f9-dcf145238ee0 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:19.422657 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a9784-2e8a-4f63-82f9-dcf145238ee0 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:19.422657 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 210/419] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:19.427913 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed52b-f62c-47be-af89-cd5a86afc859 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:19.428198 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed52b-f62c-47be-af89-cd5a86afc859 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:19.428502 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed52b-f62c-47be-af89-cd5a86afc859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:19.448649 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-962ed52b-f62c-47be-af89-cd5a86afc859 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:19.450121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-962ed52b-f62c-47be-af89-cd5a86afc859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:19.457467 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:19.515959 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd33e-e566-418b-8c6c-74d81976e21a None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:19.525563 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 211/420] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:19.526914 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f12b03-aea2-4afd-a8fb-d709324f62ae None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:19.527203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f12b03-aea2-4afd-a8fb-d709324f62ae None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:19.527551 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f12b03-aea2-4afd-a8fb-d709324f62ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:19.545807 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-94f12b03-aea2-4afd-a8fb-d709324f62ae None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:19.547097 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-94f12b03-aea2-4afd-a8fb-d709324f62ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:19.578303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cb21d-257e-4fd0-8174-96df1aff6631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:19.578938 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cb21d-257e-4fd0-8174-96df1aff6631 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:19.579283 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cb21d-257e-4fd0-8174-96df1aff6631 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:19.579559 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cb21d-257e-4fd0-8174-96df1aff6631 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:19.603991 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cb21d-257e-4fd0-8174-96df1aff6631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-175cb21d-257e-4fd0-8174-96df1aff6631 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:19.614346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:19.615292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:19.616109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:19.616109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:19.616109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:19.616109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:19.616109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:19.616109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:19.616109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:19.616109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:19.616109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:19.616109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:19.616109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:19.616109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:19.620279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 210/421] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:19.626096 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cb21d-257e-4fd0-8174-96df1aff6631 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:19.632339 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:19.670767 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 212/422] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:19.763605 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cb21d-257e-4fd0-8174-96df1aff6631 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:19.791975 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:19.815311 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3c058-0775-4c45-a21a-416f6a17f8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:19.816258 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3c058-0775-4c45-a21a-416f6a17f8a0 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:19.816756 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3c058-0775-4c45-a21a-416f6a17f8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:19.817251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3c058-0775-4c45-a21a-416f6a17f8a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:19.818670 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3c058-0775-4c45-a21a-416f6a17f8a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:19.819169 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3c058-0775-4c45-a21a-416f6a17f8a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:19.820753 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3c058-0775-4c45-a21a-416f6a17f8a0 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:19.835523 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 211/423] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:01:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:19.840398 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f12b03-aea2-4afd-a8fb-d709324f62ae None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:19.961965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3c058-0775-4c45-a21a-416f6a17f8a0 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:19.992048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f12b03-aea2-4afd-a8fb-d709324f62ae None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:20.065367 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57381091-63c9-4ec8-9c46-6b703ad6f8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:20.066383 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57381091-63c9-4ec8-9c46-6b703ad6f8de None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:20.066873 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57381091-63c9-4ec8-9c46-6b703ad6f8de None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:20.067164 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57381091-63c9-4ec8-9c46-6b703ad6f8de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:20.099025 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3c058-0775-4c45-a21a-416f6a17f8a0 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:20.143413 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0651c86-f6b9-4fbf-a628-122759255f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:20.144473 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0651c86-f6b9-4fbf-a628-122759255f5c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:20.145511 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0651c86-f6b9-4fbf-a628-122759255f5c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:20.146033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0651c86-f6b9-4fbf-a628-122759255f5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:20.158354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0651c86-f6b9-4fbf-a628-122759255f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-a0651c86-f6b9-4fbf-a628-122759255f5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:20.165078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:20.165950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:20.166742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:20.166742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:20.166742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:20.166742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:20.166742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:20.166742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:20.166742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:20.166742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:20.166742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:20.166742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:20.166742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:01:20.166742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:20.168704 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:20.170557 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 212/424] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:01:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:20.176210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0651c86-f6b9-4fbf-a628-122759255f5c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:20.216218 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57381091-63c9-4ec8-9c46-6b703ad6f8de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:20.217646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57381091-63c9-4ec8-9c46-6b703ad6f8de None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:20.229726 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:20.313896 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0651c86-f6b9-4fbf-a628-122759255f5c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:20.332659 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 213/425] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:20.333806 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57381091-63c9-4ec8-9c46-6b703ad6f8de None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:20.360145 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a0813-84e8-4dbf-8e54-d5920324892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:20.361352 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a0813-84e8-4dbf-8e54-d5920324892a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:20.361822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a0813-84e8-4dbf-8e54-d5920324892a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:20.362282 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a0813-84e8-4dbf-8e54-d5920324892a None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:20.363783 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a0813-84e8-4dbf-8e54-d5920324892a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:20.364457 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a0813-84e8-4dbf-8e54-d5920324892a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:20.367159 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a0813-84e8-4dbf-8e54-d5920324892a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:20.376542 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 213/426] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:20.377454 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a0813-84e8-4dbf-8e54-d5920324892a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:20.440091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:20.470718 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57381091-63c9-4ec8-9c46-6b703ad6f8de None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:20.495625 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a0813-84e8-4dbf-8e54-d5920324892a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:20.497397 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:20.519554 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786cfa7-28e0-4b58-af48-2ad7bdd69050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:20.520198 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786cfa7-28e0-4b58-af48-2ad7bdd69050 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:20.520475 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786cfa7-28e0-4b58-af48-2ad7bdd69050 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:20.520742 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786cfa7-28e0-4b58-af48-2ad7bdd69050 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:20.534236 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786cfa7-28e0-4b58-af48-2ad7bdd69050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:20.536051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446f277-4d0c-41c2-8141-aa7b5be47c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:20.537232 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446f277-4d0c-41c2-8141-aa7b5be47c17 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:20.537508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446f277-4d0c-41c2-8141-aa7b5be47c17 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:20.537836 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446f277-4d0c-41c2-8141-aa7b5be47c17 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:20.539030 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446f277-4d0c-41c2-8141-aa7b5be47c17 None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:20.540517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446f277-4d0c-41c2-8141-aa7b5be47c17 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-2786cfa7-28e0-4b58-af48-2ad7bdd69050 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:20.541847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:20.542722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:20.543533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:20.543533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:20.543533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:20.543533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:20.543533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:20.543533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:20.543533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:20.543533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:20.543533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:20.543533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:20.543533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:01:20.543533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:20.544143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 214/427] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:20 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:20.544143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446f277-4d0c-41c2-8141-aa7b5be47c17 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:20.546564 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 214/428] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:20.548608 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786cfa7-28e0-4b58-af48-2ad7bdd69050 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:20.676310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786cfa7-28e0-4b58-af48-2ad7bdd69050 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:20.685762 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446f277-4d0c-41c2-8141-aa7b5be47c17 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:20.726244 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703240e0-f5b6-460c-a182-a2337fe12e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:20.726779 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703240e0-f5b6-460c-a182-a2337fe12e01 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:20.727065 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703240e0-f5b6-460c-a182-a2337fe12e01 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:20.727365 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703240e0-f5b6-460c-a182-a2337fe12e01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:20.729147 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722f240-7bde-47af-b5af-066fe75241dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:20.730270 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722f240-7bde-47af-b5af-066fe75241dc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:20.730747 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722f240-7bde-47af-b5af-066fe75241dc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:20.731751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722f240-7bde-47af-b5af-066fe75241dc None admin] PATH_INFO: `/v3/groups/b04d1b4bd17f4e4183004cd26b418b32` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:20.732840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722f240-7bde-47af-b5af-066fe75241dc None admin] RBAC: Authorizing `identity:get_group(group_id=b04d1b4bd17f4e4183004cd26b418b32)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:20.734493 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722f240-7bde-47af-b5af-066fe75241dc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:20.736303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 215/429] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:20 2022] GET /identity/v3/groups/b04d1b4bd17f4e4183004cd26b418b32 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:20.737829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722f240-7bde-47af-b5af-066fe75241dc None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:20.747673 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:20.779895 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:20.817249 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703240e0-f5b6-460c-a182-a2337fe12e01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:20.819288 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703240e0-f5b6-460c-a182-a2337fe12e01 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:20.855344 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722f240-7bde-47af-b5af-066fe75241dc None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:20.890836 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afe34e-e651-4456-a84e-72df382b76b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:20.891471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe34e-e651-4456-a84e-72df382b76b7 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:20.891751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe34e-e651-4456-a84e-72df382b76b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:20.892045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe34e-e651-4456-a84e-72df382b76b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:20.892704 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9afe34e-e651-4456-a84e-72df382b76b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:20.893007 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9afe34e-e651-4456-a84e-72df382b76b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:20.894371 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9afe34e-e651-4456-a84e-72df382b76b7 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:20.903062 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 216/430] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:01:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:20.903900 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afe34e-e651-4456-a84e-72df382b76b7 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:20.935153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 215/431] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:20.936671 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ca03-2bb2-4804-93f5-a958387c5c02 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:20.937219 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ca03-2bb2-4804-93f5-a958387c5c02 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:20.937939 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ca03-2bb2-4804-93f5-a958387c5c02 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:20.939768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 216/432] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:20.940662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ca03-2bb2-4804-93f5-a958387c5c02 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:20.984763 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:21.020794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:21.026703 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afe34e-e651-4456-a84e-72df382b76b7 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:21.056621 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ca03-2bb2-4804-93f5-a958387c5c02 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:21.063822 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dca051-b18d-452a-a859-277ff8c77a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:21.064430 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dca051-b18d-452a-a859-277ff8c77a05 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.064712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dca051-b18d-452a-a859-277ff8c77a05 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.064986 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dca051-b18d-452a-a859-277ff8c77a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.065706 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dca051-b18d-452a-a859-277ff8c77a05 None admin] RBAC: Adding query filter params (group.id=b04d1b4bd17f4e4183004cd26b418b32, role.id=70cebcd047db4003b7016de5c93cab80, scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:21.066008 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dca051-b18d-452a-a859-277ff8c77a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:21.067543 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dca051-b18d-452a-a859-277ff8c77a05 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:21.081140 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 217/433] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Aug 18 21:01:20 2022] GET /identity/v3/role_assignments?group.id=b04d1b4bd17f4e4183004cd26b418b32&scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412&role.id=70cebcd047db4003b7016de5c93cab80 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:21.081140 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dca051-b18d-452a-a859-277ff8c77a05 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:21.119847 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4459c0-fe00-4371-8ed5-5123e3e5fe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:21.120854 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4459c0-fe00-4371-8ed5-5123e3e5fe99 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.122165 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4459c0-fe00-4371-8ed5-5123e3e5fe99 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.122506 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4459c0-fe00-4371-8ed5-5123e3e5fe99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.197313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dca051-b18d-452a-a859-277ff8c77a05 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:21.201633 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4459c0-fe00-4371-8ed5-5123e3e5fe99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:21.203114 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4459c0-fe00-4371-8ed5-5123e3e5fe99 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:21.230925 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:21.237512 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9fd24-0e4f-4dce-a51b-ee865b0d71b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:21.238130 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9fd24-0e4f-4dce-a51b-ee865b0d71b3 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.238413 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9fd24-0e4f-4dce-a51b-ee865b0d71b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.238744 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9fd24-0e4f-4dce-a51b-ee865b0d71b3 None admin] PATH_INFO: `/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.240782 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9fd24-0e4f-4dce-a51b-ee865b0d71b3 None admin] RBAC: Authorizing `identity:get_project(project_id=aa7e7bc5516444f2be8b5dae7b0c4412)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:21.242267 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9fd24-0e4f-4dce-a51b-ee865b0d71b3 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:21.248953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 218/434] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:21 2022] GET /identity/v3/projects/aa7e7bc5516444f2be8b5dae7b0c4412 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:21.248953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d96e7-f243-4225-80d1-9af182e6fb30 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.248953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d96e7-f243-4225-80d1-9af182e6fb30 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.248953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d96e7-f243-4225-80d1-9af182e6fb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.265324 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-251d96e7-f243-4225-80d1-9af182e6fb30 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:21.266981 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-251d96e7-f243-4225-80d1-9af182e6fb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:21.287914 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:21.326319 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 217/435] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:21.328916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684375bd-649e-4bb2-8b9b-c72cd02223fc None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.328916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684375bd-649e-4bb2-8b9b-c72cd02223fc None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.328916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684375bd-649e-4bb2-8b9b-c72cd02223fc None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.334263 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 218/436] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:21.334263 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684375bd-649e-4bb2-8b9b-c72cd02223fc None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:21.359134 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 219/437] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:21.360042 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d96e7-f243-4225-80d1-9af182e6fb30 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:21.467603 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684375bd-649e-4bb2-8b9b-c72cd02223fc None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:21.484492 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d96e7-f243-4225-80d1-9af182e6fb30 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:21.513405 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9e1da-a788-4b95-974a-1f00d5ba1561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:21.514330 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9e1da-a788-4b95-974a-1f00d5ba1561 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.514671 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9e1da-a788-4b95-974a-1f00d5ba1561 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.515010 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9e1da-a788-4b95-974a-1f00d5ba1561 None admin] PATH_INFO: `/v3/groups/b04d1b4bd17f4e4183004cd26b418b32` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.516149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9e1da-a788-4b95-974a-1f00d5ba1561 None admin] RBAC: Authorizing `identity:get_group(group_id=b04d1b4bd17f4e4183004cd26b418b32)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:21.518113 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9e1da-a788-4b95-974a-1f00d5ba1561 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:21.525372 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 219/438] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:21 2022] GET /identity/v3/groups/b04d1b4bd17f4e4183004cd26b418b32 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:21.525527 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:21.525605 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52630c9-8354-42e6-a46d-73b351921fb5 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.525605 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52630c9-8354-42e6-a46d-73b351921fb5 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.525605 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52630c9-8354-42e6-a46d-73b351921fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.531071 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba238e-d500-400b-8720-1c5b198733bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:21.532813 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba238e-d500-400b-8720-1c5b198733bf None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.533097 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba238e-d500-400b-8720-1c5b198733bf None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.533371 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba238e-d500-400b-8720-1c5b198733bf None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.534518 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba238e-d500-400b-8720-1c5b198733bf None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:21.536030 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba238e-d500-400b-8720-1c5b198733bf None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:21.538939 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 220/439] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:21 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:21.539766 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba238e-d500-400b-8720-1c5b198733bf None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:21.545603 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-d52630c9-8354-42e6-a46d-73b351921fb5 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:21.547157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-d52630c9-8354-42e6-a46d-73b351921fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:21.585072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:21.631320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 220/440] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:21.631320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52630c9-8354-42e6-a46d-73b351921fb5 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:21.660531 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba238e-d500-400b-8720-1c5b198733bf None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:21.696508 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f13036-4efd-4061-992f-35920b0c5c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:21.697370 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f13036-4efd-4061-992f-35920b0c5c1c None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.697803 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f13036-4efd-4061-992f-35920b0c5c1c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.698205 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f13036-4efd-4061-992f-35920b0c5c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.699342 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f13036-4efd-4061-992f-35920b0c5c1c None admin] RBAC: Adding query filter params (group.id=b04d1b4bd17f4e4183004cd26b418b32, role.id=5d73f21ba2e940f38026b109b9c9e10e, scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:21.699817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f13036-4efd-4061-992f-35920b0c5c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:21.701390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f13036-4efd-4061-992f-35920b0c5c1c None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:21.707537 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 221/441] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Aug 18 21:01:21 2022] GET /identity/v3/role_assignments?group.id=b04d1b4bd17f4e4183004cd26b418b32&scope.project.id=aa7e7bc5516444f2be8b5dae7b0c4412&role.id=5d73f21ba2e940f38026b109b9c9e10e => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:21.708495 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f13036-4efd-4061-992f-35920b0c5c1c None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:21.749119 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52630c9-8354-42e6-a46d-73b351921fb5 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:21.787991 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:21.791895 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877af3f-c490-4fc5-99fb-5c5153496e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:21.792652 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877af3f-c490-4fc5-99fb-5c5153496e85 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.793005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877af3f-c490-4fc5-99fb-5c5153496e85 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.793350 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877af3f-c490-4fc5-99fb-5c5153496e85 None admin] PATH_INFO: `/v3/groups/b04d1b4bd17f4e4183004cd26b418b32` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.795347 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877af3f-c490-4fc5-99fb-5c5153496e85 None admin] RBAC: Authorizing `identity:get_group(group_id=b04d1b4bd17f4e4183004cd26b418b32)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:21.797075 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877af3f-c490-4fc5-99fb-5c5153496e85 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:21.799116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 221/442] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:21 2022] GET /identity/v3/groups/b04d1b4bd17f4e4183004cd26b418b32 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:21.807022 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877af3f-c490-4fc5-99fb-5c5153496e85 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:21.848707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f13036-4efd-4061-992f-35920b0c5c1c None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:21.853438 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:21.899915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675aeb68-e02b-4af4-832e-97dcd9f18a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:21.901302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aeb68-e02b-4af4-832e-97dcd9f18a67 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.901731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aeb68-e02b-4af4-832e-97dcd9f18a67 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.902426 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aeb68-e02b-4af4-832e-97dcd9f18a67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.918144 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675aeb68-e02b-4af4-832e-97dcd9f18a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-675aeb68-e02b-4af4-832e-97dcd9f18a67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:21.925277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:21.926226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:21.927098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:21.927098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:21.927098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:21.927098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:21.927098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:21.927098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:21.927098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:21.927098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:21.927098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:21.927098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:21.927098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:01:21.927098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:21.929290 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 222/443] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:01:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:21.930153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675aeb68-e02b-4af4-832e-97dcd9f18a67 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:21.946334 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877af3f-c490-4fc5-99fb-5c5153496e85 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:21.988035 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7efc2-f4f3-4290-9b82-35d85ae1c68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:21.988640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7efc2-f4f3-4290-9b82-35d85ae1c68d None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.988928 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7efc2-f4f3-4290-9b82-35d85ae1c68d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.989198 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7efc2-f4f3-4290-9b82-35d85ae1c68d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.989948 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7efc2-f4f3-4290-9b82-35d85ae1c68d None admin] RBAC: Adding query filter params (group.id=b04d1b4bd17f4e4183004cd26b418b32, role.id=70cebcd047db4003b7016de5c93cab80, scope.project.id=59b28d193e75472297193587da13dcc8) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:21.990259 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7efc2-f4f3-4290-9b82-35d85ae1c68d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:21.992863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7efc2-f4f3-4290-9b82-35d85ae1c68d None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:21.998857 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 222/444] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Aug 18 21:01:21 2022] GET /identity/v3/role_assignments?group.id=b04d1b4bd17f4e4183004cd26b418b32&scope.project.id=59b28d193e75472297193587da13dcc8&role.id=70cebcd047db4003b7016de5c93cab80 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:21.999762 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7efc2-f4f3-4290-9b82-35d85ae1c68d None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:22.074074 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675aeb68-e02b-4af4-832e-97dcd9f18a67 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:22.110929 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:22.135382 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d140b7d-0668-4c99-823d-87f26e7380cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:22.135997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d140b7d-0668-4c99-823d-87f26e7380cd None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.136806 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d140b7d-0668-4c99-823d-87f26e7380cd None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.136806 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d140b7d-0668-4c99-823d-87f26e7380cd None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.137197 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d140b7d-0668-4c99-823d-87f26e7380cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:22.137496 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d140b7d-0668-4c99-823d-87f26e7380cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:22.138888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d140b7d-0668-4c99-823d-87f26e7380cd None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:22.149167 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 223/445] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:22.154636 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7efc2-f4f3-4290-9b82-35d85ae1c68d None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:22.157111 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:22.157714 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d140b7d-0668-4c99-823d-87f26e7380cd None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:22.200907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f94f9-e46d-46aa-a056-19362884d6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:22.201652 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f94f9-e46d-46aa-a056-19362884d6ae None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.201994 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f94f9-e46d-46aa-a056-19362884d6ae None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.202280 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f94f9-e46d-46aa-a056-19362884d6ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.219171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f94f9-e46d-46aa-a056-19362884d6ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-917f94f9-e46d-46aa-a056-19362884d6ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:22.225780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:22.226691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:22.227526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:22.227526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:22.227526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:22.227526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:22.227526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:22.227526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:22.227526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:22.227526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:22.227526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:22.227526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:22.227526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:01:22.227526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:22.231367 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 223/446] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:01:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:22.232995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f94f9-e46d-46aa-a056-19362884d6ae None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:22.298755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d140b7d-0668-4c99-823d-87f26e7380cd None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:22.338020 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a002d-6663-444b-a401-d29115bf4df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:22.338544 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a002d-6663-444b-a401-d29115bf4df1 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.338824 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a002d-6663-444b-a401-d29115bf4df1 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.339099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a002d-6663-444b-a401-d29115bf4df1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.368124 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f94f9-e46d-46aa-a056-19362884d6ae None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:22.407699 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:22.414012 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508e8a2-157c-49c6-abf3-ce9bb1b576ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:22.414618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508e8a2-157c-49c6-abf3-ce9bb1b576ca None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.414895 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508e8a2-157c-49c6-abf3-ce9bb1b576ca None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.415162 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508e8a2-157c-49c6-abf3-ce9bb1b576ca None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.415845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508e8a2-157c-49c6-abf3-ce9bb1b576ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:22.416149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508e8a2-157c-49c6-abf3-ce9bb1b576ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:22.417505 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508e8a2-157c-49c6-abf3-ce9bb1b576ca None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:22.427924 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 224/447] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:22.433864 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508e8a2-157c-49c6-abf3-ce9bb1b576ca None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:22.434775 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a002d-6663-444b-a401-d29115bf4df1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:22.436424 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a002d-6663-444b-a401-d29115bf4df1 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:22.459569 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:22.533854 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 224/448] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 21:01:22.534025 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508e8a2-157c-49c6-abf3-ce9bb1b576ca None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:22.539503 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a002d-6663-444b-a401-d29115bf4df1 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:22.568521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff937da-3eb7-4f96-8ab5-2f765d6da9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:22.569125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff937da-3eb7-4f96-8ab5-2f765d6da9cb None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.569407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff937da-3eb7-4f96-8ab5-2f765d6da9cb None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.569683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff937da-3eb7-4f96-8ab5-2f765d6da9cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.621678 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:22.637458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff937da-3eb7-4f96-8ab5-2f765d6da9cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:22.638434 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a002d-6663-444b-a401-d29115bf4df1 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:22.638920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff937da-3eb7-4f96-8ab5-2f765d6da9cb None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:22.667742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:22.676550 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3f99e-197a-4636-9976-bc8d3da113aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:22.677739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3f99e-197a-4636-9976-bc8d3da113aa None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.678016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3f99e-197a-4636-9976-bc8d3da113aa None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.678287 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3f99e-197a-4636-9976-bc8d3da113aa None admin] PATH_INFO: `/v3/projects/59b28d193e75472297193587da13dcc8` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.679437 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3f99e-197a-4636-9976-bc8d3da113aa None admin] RBAC: Authorizing `identity:get_project(project_id=59b28d193e75472297193587da13dcc8)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:22.680867 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3f99e-197a-4636-9976-bc8d3da113aa None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:22.682482 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 225/449] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:22 2022] GET /identity/v3/projects/59b28d193e75472297193587da13dcc8 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:22.687938 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3f99e-197a-4636-9976-bc8d3da113aa None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:22.744180 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 225/450] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 21:01:22.749684 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff937da-3eb7-4f96-8ab5-2f765d6da9cb None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:22.785266 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3f99e-197a-4636-9976-bc8d3da113aa None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:22.819393 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f58792-2a71-49c1-9be8-790282cfcdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:22.820018 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f58792-2a71-49c1-9be8-790282cfcdb6 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.820300 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f58792-2a71-49c1-9be8-790282cfcdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.820574 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f58792-2a71-49c1-9be8-790282cfcdb6 None admin] PATH_INFO: `/v3/groups/b04d1b4bd17f4e4183004cd26b418b32` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.821709 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f58792-2a71-49c1-9be8-790282cfcdb6 None admin] RBAC: Authorizing `identity:get_group(group_id=b04d1b4bd17f4e4183004cd26b418b32)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:22.823172 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f58792-2a71-49c1-9be8-790282cfcdb6 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:22.825034 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 226/451] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:22 2022] GET /identity/v3/groups/b04d1b4bd17f4e4183004cd26b418b32 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:22.830779 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f58792-2a71-49c1-9be8-790282cfcdb6 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:22.846654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff937da-3eb7-4f96-8ab5-2f765d6da9cb None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:22.851948 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:22.868667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:22.880679 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06217037-03f2-4315-bcc7-89bc22900705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:22.881333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06217037-03f2-4315-bcc7-89bc22900705 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.881611 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06217037-03f2-4315-bcc7-89bc22900705 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.881880 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06217037-03f2-4315-bcc7-89bc22900705 None admin] PATH_INFO: `/v3/projects/9fde81811a6d48dea0f606eb2c250dc9` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.882992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06217037-03f2-4315-bcc7-89bc22900705 None admin] RBAC: Authorizing `identity:get_project(project_id=9fde81811a6d48dea0f606eb2c250dc9)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:22.884445 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06217037-03f2-4315-bcc7-89bc22900705 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:22.886047 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 226/452] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Aug 18 21:01:22 2022] GET /identity/v3/projects/9fde81811a6d48dea0f606eb2c250dc9 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:22.891426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06217037-03f2-4315-bcc7-89bc22900705 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:22.928400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f58792-2a71-49c1-9be8-790282cfcdb6 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:22.962851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14336f84-a35b-4057-a9e3-da5f7751059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:22.963468 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14336f84-a35b-4057-a9e3-da5f7751059a None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.963747 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14336f84-a35b-4057-a9e3-da5f7751059a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.964016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14336f84-a35b-4057-a9e3-da5f7751059a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.964718 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14336f84-a35b-4057-a9e3-da5f7751059a None admin] RBAC: Adding query filter params (group.id=b04d1b4bd17f4e4183004cd26b418b32, role.id=5d73f21ba2e940f38026b109b9c9e10e, scope.project.id=59b28d193e75472297193587da13dcc8) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:22.965021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14336f84-a35b-4057-a9e3-da5f7751059a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:22.966446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14336f84-a35b-4057-a9e3-da5f7751059a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:22.971933 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 227/453] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Aug 18 21:01:22 2022] GET /identity/v3/role_assignments?group.id=b04d1b4bd17f4e4183004cd26b418b32&scope.project.id=59b28d193e75472297193587da13dcc8&role.id=5d73f21ba2e940f38026b109b9c9e10e => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:22.991114 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06217037-03f2-4315-bcc7-89bc22900705 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:23.028145 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829a739-30df-462c-8b4c-e5fdaf471470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:23.028791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829a739-30df-462c-8b4c-e5fdaf471470 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:23.029071 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829a739-30df-462c-8b4c-e5fdaf471470 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:23.029343 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829a739-30df-462c-8b4c-e5fdaf471470 None admin] PATH_INFO: `/v3/groups/f5f46016e2de4180b271346dab1a36bf` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:23.030528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829a739-30df-462c-8b4c-e5fdaf471470 None admin] RBAC: Authorizing `identity:get_group(group_id=f5f46016e2de4180b271346dab1a36bf)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:23.032043 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829a739-30df-462c-8b4c-e5fdaf471470 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:23.033700 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 227/454] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Aug 18 21:01:22 2022] GET /identity/v3/groups/f5f46016e2de4180b271346dab1a36bf => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:23.040416 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14336f84-a35b-4057-a9e3-da5f7751059a None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:23.128817 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:23.147377 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14336f84-a35b-4057-a9e3-da5f7751059a None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:23.183103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1895b-aef3-46c1-9e06-956eac5095fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:23.183736 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1895b-aef3-46c1-9e06-956eac5095fc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:23.184016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1895b-aef3-46c1-9e06-956eac5095fc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:23.184291 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1895b-aef3-46c1-9e06-956eac5095fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:23.185003 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1895b-aef3-46c1-9e06-956eac5095fc None admin] RBAC: Adding query filter params (group.id=f5f46016e2de4180b271346dab1a36bf, role.id=49c7d15532d94cafac420a6bcf8574ad, scope.project.id=9fde81811a6d48dea0f606eb2c250dc9) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:23.185314 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1895b-aef3-46c1-9e06-956eac5095fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:23.186753 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1895b-aef3-46c1-9e06-956eac5095fc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:23.192638 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 228/455] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Aug 18 21:01:23 2022] GET /identity/v3/role_assignments?group.id=f5f46016e2de4180b271346dab1a36bf&scope.project.id=9fde81811a6d48dea0f606eb2c250dc9&role.id=49c7d15532d94cafac420a6bcf8574ad => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:25.711438 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea1700-3cb2-4fde-baf6-9314d2a99cfb None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:25.712465 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea1700-3cb2-4fde-baf6-9314d2a99cfb None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:25.712952 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea1700-3cb2-4fde-baf6-9314d2a99cfb None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:25.714964 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 228/456] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:25.720630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1370b7c-4c49-4da2-a5e9-8316de7180d6 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:25.721176 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1370b7c-4c49-4da2-a5e9-8316de7180d6 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:25.721176 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1370b7c-4c49-4da2-a5e9-8316de7180d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:25.742813 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-a1370b7c-4c49-4da2-a5e9-8316de7180d6 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:25.744059 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-a1370b7c-4c49-4da2-a5e9-8316de7180d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:25.815297 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 229/457] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:25.896448 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb068c8-5a17-45bc-ad1f-aeb869a45128 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:25.896732 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb068c8-5a17-45bc-ad1f-aeb869a45128 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:25.896930 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb068c8-5a17-45bc-ad1f-aeb869a45128 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:25.898557 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 229/458] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:25.903910 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e067d-b5ae-44e3-bc5a-9a7b29edba56 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:25.904196 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e067d-b5ae-44e3-bc5a-9a7b29edba56 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:25.904467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e067d-b5ae-44e3-bc5a-9a7b29edba56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:25.928744 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-bd0e067d-b5ae-44e3-bc5a-9a7b29edba56 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:25.929928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-bd0e067d-b5ae-44e3-bc5a-9a7b29edba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:25.999667 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 230/459] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:26.036005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4fb5a-b080-4179-a127-b7d73953d0e7 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:26.036342 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4fb5a-b080-4179-a127-b7d73953d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:26.036592 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4fb5a-b080-4179-a127-b7d73953d0e7 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:26.038178 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 230/460] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:26.043180 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b21b5-bfad-4d45-b436-7250d1ae1646 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:26.043502 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b21b5-bfad-4d45-b436-7250d1ae1646 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:26.043777 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b21b5-bfad-4d45-b436-7250d1ae1646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:26.062733 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-9a5b21b5-bfad-4d45-b436-7250d1ae1646 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:26.063931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-9a5b21b5-bfad-4d45-b436-7250d1ae1646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:26.065825 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:26.143428 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 231/461] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:26.177598 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4fb5a-b080-4179-a127-b7d73953d0e7 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:26.237961 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:26.281356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4fb5a-b080-4179-a127-b7d73953d0e7 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:26.288939 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82eb0a-a152-4f3f-b3f4-224a386fd01c None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:26.289479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82eb0a-a152-4f3f-b3f4-224a386fd01c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:26.289824 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82eb0a-a152-4f3f-b3f4-224a386fd01c None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:26.291480 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 232/462] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:26.297549 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d601389-c420-4061-8d67-1e219253d525 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:26.298090 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d601389-c420-4061-8d67-1e219253d525 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:26.298617 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d601389-c420-4061-8d67-1e219253d525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:26.319166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be5533-25a9-4ca8-b87c-fc7bde2870dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:26.320120 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be5533-25a9-4ca8-b87c-fc7bde2870dd None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:26.320576 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be5533-25a9-4ca8-b87c-fc7bde2870dd None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:26.321174 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be5533-25a9-4ca8-b87c-fc7bde2870dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:26.321841 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-8d601389-c420-4061-8d67-1e219253d525 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:26.323083 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-8d601389-c420-4061-8d67-1e219253d525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:26.332635 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be5533-25a9-4ca8-b87c-fc7bde2870dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:26.334939 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be5533-25a9-4ca8-b87c-fc7bde2870dd None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-f2be5533-25a9-4ca8-b87c-fc7bde2870dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:26.352970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:26.354053 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:26.354897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:26.354897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:26.354897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:26.355076 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 231/463] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:26.356431 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be5533-25a9-4ca8-b87c-fc7bde2870dd None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:26.407021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 233/464] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:26.408208 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d601389-c420-4061-8d67-1e219253d525 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:26.474238 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be5533-25a9-4ca8-b87c-fc7bde2870dd None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:26.485031 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:26.485725 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:26.509170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8927e36-2830-4bdc-b7aa-7b7ab68607c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:26.509869 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8927e36-2830-4bdc-b7aa-7b7ab68607c8 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:26.510153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8927e36-2830-4bdc-b7aa-7b7ab68607c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:26.510422 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8927e36-2830-4bdc-b7aa-7b7ab68607c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:26.521177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8927e36-2830-4bdc-b7aa-7b7ab68607c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:26.522628 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8927e36-2830-4bdc-b7aa-7b7ab68607c8 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:26.527465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d601389-c420-4061-8d67-1e219253d525 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-c8927e36-2830-4bdc-b7aa-7b7ab68607c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:26.537394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:26.538388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:26.539237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:26.539237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:26.539237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:26.539237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 232/465] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:26.539237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8927e36-2830-4bdc-b7aa-7b7ab68607c8 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:26.570343 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c4cdf-b4bd-4f49-8fda-503f32648d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:26.571309 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c4cdf-b4bd-4f49-8fda-503f32648d6a None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:26.571626 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c4cdf-b4bd-4f49-8fda-503f32648d6a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:26.571909 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c4cdf-b4bd-4f49-8fda-503f32648d6a None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:26.572495 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c4cdf-b4bd-4f49-8fda-503f32648d6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:26.572797 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c4cdf-b4bd-4f49-8fda-503f32648d6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:26.574413 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c4cdf-b4bd-4f49-8fda-503f32648d6a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:26.586627 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 234/466] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:26.588213 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c4cdf-b4bd-4f49-8fda-503f32648d6a None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:26.651821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8927e36-2830-4bdc-b7aa-7b7ab68607c8 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:26.685673 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fee0e7-940a-4fb5-be52-d93d7acc486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:26.686291 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fee0e7-940a-4fb5-be52-d93d7acc486e None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:26.686568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fee0e7-940a-4fb5-be52-d93d7acc486e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:26.686838 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fee0e7-940a-4fb5-be52-d93d7acc486e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:26.697542 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fee0e7-940a-4fb5-be52-d93d7acc486e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:26.699226 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fee0e7-940a-4fb5-be52-d93d7acc486e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:26.701033 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c4cdf-b4bd-4f49-8fda-503f32648d6a None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-56fee0e7-940a-4fb5-be52-d93d7acc486e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:26.713407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:26.714649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:26.715521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:26.715521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:26.715521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:26.715521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 233/467] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:26.715521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fee0e7-940a-4fb5-be52-d93d7acc486e None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:26.733969 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:26.735926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:26.745080 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd735147-977d-46a5-aac2-30d0c065f12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:26.745902 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd735147-977d-46a5-aac2-30d0c065f12c None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:26.746475 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd735147-977d-46a5-aac2-30d0c065f12c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:26.746751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd735147-977d-46a5-aac2-30d0c065f12c None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:26.747561 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd735147-977d-46a5-aac2-30d0c065f12c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:26.747865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd735147-977d-46a5-aac2-30d0c065f12c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:26.749232 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd735147-977d-46a5-aac2-30d0c065f12c None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:26.762117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 235/468] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:26.762930 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd735147-977d-46a5-aac2-30d0c065f12c None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:26.822986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fee0e7-940a-4fb5-be52-d93d7acc486e None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:26.855033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a4a5b-9520-4c7a-9726-ebd0ebecfea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:26.855659 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a4a5b-9520-4c7a-9726-ebd0ebecfea7 None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:26.855938 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a4a5b-9520-4c7a-9726-ebd0ebecfea7 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:26.856212 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a4a5b-9520-4c7a-9726-ebd0ebecfea7 None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:26.856841 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a4a5b-9520-4c7a-9726-ebd0ebecfea7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:26.858284 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a4a5b-9520-4c7a-9726-ebd0ebecfea7 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:26.858807 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd735147-977d-46a5-aac2-30d0c065f12c None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:26.878997 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 234/469] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Aug 18 21:01:26 2022] POST /identity/v3/users => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:01:26.880735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a4a5b-9520-4c7a-9726-ebd0ebecfea7 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:26.905384 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ad64b-6098-477e-ad1c-b8b3d9596c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:26.906003 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ad64b-6098-477e-ad1c-b8b3d9596c71 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:26.906283 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ad64b-6098-477e-ad1c-b8b3d9596c71 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:26.906554 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ad64b-6098-477e-ad1c-b8b3d9596c71 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:26.907215 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ad64b-6098-477e-ad1c-b8b3d9596c71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:26.907557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ad64b-6098-477e-ad1c-b8b3d9596c71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:26.908992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ad64b-6098-477e-ad1c-b8b3d9596c71 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:26.926071 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 236/470] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:26.928262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ad64b-6098-477e-ad1c-b8b3d9596c71 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:26.967550 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:26.994129 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:27.006229 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a4a5b-9520-4c7a-9726-ebd0ebecfea7 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:27.045423 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3fc48-58ea-4438-b8bb-c08fef3be902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:27.046061 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3fc48-58ea-4438-b8bb-c08fef3be902 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:27.046345 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3fc48-58ea-4438-b8bb-c08fef3be902 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:27.046620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3fc48-58ea-4438-b8bb-c08fef3be902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:27.054374 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ad64b-6098-477e-ad1c-b8b3d9596c71 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:27.060578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3fc48-58ea-4438-b8bb-c08fef3be902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:27.061333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3fc48-58ea-4438-b8bb-c08fef3be902 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-10a3fc48-58ea-4438-b8bb-c08fef3be902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:27.077683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:27.078610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:27.080722 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:27.080722 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:27.080722 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:27.080722 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 235/471] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:27.080722 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3fc48-58ea-4438-b8bb-c08fef3be902 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:27.094509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca23e-593d-47f1-8475-d895a27f31e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:27.095471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca23e-593d-47f1-8475-d895a27f31e9 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:27.095748 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca23e-593d-47f1-8475-d895a27f31e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:27.096021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca23e-593d-47f1-8475-d895a27f31e9 None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:27.096654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aca23e-593d-47f1-8475-d895a27f31e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:27.098074 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aca23e-593d-47f1-8475-d895a27f31e9 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:27.122986 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 237/472] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Aug 18 21:01:26 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:01:27.123944 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca23e-593d-47f1-8475-d895a27f31e9 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:27.212786 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3fc48-58ea-4438-b8bb-c08fef3be902 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:27.240525 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:27.255815 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b176da1-0181-4a37-9de2-cb39f0c5596b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:27.256509 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b176da1-0181-4a37-9de2-cb39f0c5596b None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:27.256944 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b176da1-0181-4a37-9de2-cb39f0c5596b None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:27.257325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b176da1-0181-4a37-9de2-cb39f0c5596b None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:27.258419 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b176da1-0181-4a37-9de2-cb39f0c5596b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:27.259951 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b176da1-0181-4a37-9de2-cb39f0c5596b None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:27.278463 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca23e-593d-47f1-8475-d895a27f31e9 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:27.282952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:27.288897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 236/473] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Aug 18 21:01:27 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:01:27.331460 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a36de-0764-4cfd-b923-988350207696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:27.332648 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a36de-0764-4cfd-b923-988350207696 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:27.333772 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a36de-0764-4cfd-b923-988350207696 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:27.334246 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a36de-0764-4cfd-b923-988350207696 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:27.335146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a36de-0764-4cfd-b923-988350207696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:27.335685 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a36de-0764-4cfd-b923-988350207696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:27.337281 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a36de-0764-4cfd-b923-988350207696 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:27.351957 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 238/474] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:27.358161 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b176da1-0181-4a37-9de2-cb39f0c5596b None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:27.475080 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b176da1-0181-4a37-9de2-cb39f0c5596b None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:27.510699 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0a3da-2dd6-4d56-a8cb-3b85b467e6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:27.511420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0a3da-2dd6-4d56-a8cb-3b85b467e6a9 None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:27.511800 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0a3da-2dd6-4d56-a8cb-3b85b467e6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:27.512173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0a3da-2dd6-4d56-a8cb-3b85b467e6a9 None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:27.512916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0a3da-2dd6-4d56-a8cb-3b85b467e6a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:27.514486 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0a3da-2dd6-4d56-a8cb-3b85b467e6a9 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:27.538961 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 237/475] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Aug 18 21:01:27 2022] POST /identity/v3/users => generated 249 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:01:29.193905 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb6cc-2ed7-46ec-adde-6caea4a4a70b None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:29.194417 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb6cc-2ed7-46ec-adde-6caea4a4a70b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:29.194492 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb6cc-2ed7-46ec-adde-6caea4a4a70b None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:29.196025 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 239/476] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:29.201628 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55652a-5cf2-4730-aab1-be205649c49b None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:29.202029 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55652a-5cf2-4730-aab1-be205649c49b None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:29.202167 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55652a-5cf2-4730-aab1-be205649c49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:29.220946 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-1c55652a-5cf2-4730-aab1-be205649c49b None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:29.222134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-1c55652a-5cf2-4730-aab1-be205649c49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:29.250722 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:29.299597 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 238/477] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:29.521498 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653caae9-748c-4170-8469-20af00dbaad2 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:29.521951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653caae9-748c-4170-8469-20af00dbaad2 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:29.522314 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653caae9-748c-4170-8469-20af00dbaad2 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:29.524045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 240/478] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:29.529179 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa6c18-db7d-42de-9384-55fdace296f3 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:29.529549 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa6c18-db7d-42de-9384-55fdace296f3 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:29.529897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa6c18-db7d-42de-9384-55fdace296f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:29.549065 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-ebfa6c18-db7d-42de-9384-55fdace296f3 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:29.550250 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-ebfa6c18-db7d-42de-9384-55fdace296f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:29.626635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6bb3c-292f-4a91-a960-14199361e57c None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:29.626947 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6bb3c-292f-4a91-a960-14199361e57c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:29.627198 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6bb3c-292f-4a91-a960-14199361e57c None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:29.628785 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 241/479] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:29.630465 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 239/480] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:29.633802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6bb3c-292f-4a91-a960-14199361e57c None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:29.636728 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7faf0-0309-442c-a1a9-555327b8a002 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:29.637024 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7faf0-0309-442c-a1a9-555327b8a002 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:29.637301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7faf0-0309-442c-a1a9-555327b8a002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:29.654732 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-a3d7faf0-0309-442c-a1a9-555327b8a002 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:29.656021 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-a3d7faf0-0309-442c-a1a9-555327b8a002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:29.735576 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 240/481] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:29.766868 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6bb3c-292f-4a91-a960-14199361e57c None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:29.802616 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae17615-eb30-4978-bf46-1a05f15cf6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:29.803167 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae17615-eb30-4978-bf46-1a05f15cf6c8 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:29.803477 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae17615-eb30-4978-bf46-1a05f15cf6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:29.803753 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae17615-eb30-4978-bf46-1a05f15cf6c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:29.814265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae17615-eb30-4978-bf46-1a05f15cf6c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-7ae17615-eb30-4978-bf46-1a05f15cf6c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:29.820465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:29.821349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:29.822137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:29.822137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:29.822137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:29.822137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:29.822137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:29.822137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:29.822137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:29.822137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:29.822137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:29.822137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:29.822137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:29.822137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:29.822137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 242/482] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:29.829315 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7faf0-0309-442c-a1a9-555327b8a002 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:29.855044 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:29.879007 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae2fd-7bd9-48ef-95fa-c2944c11d73b None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:29.879321 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae2fd-7bd9-48ef-95fa-c2944c11d73b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:29.879662 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae2fd-7bd9-48ef-95fa-c2944c11d73b None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:29.881777 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 243/483] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:01:29.888104 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a2891-4b65-440f-bf88-b71184afa97b None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:29.888636 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a2891-4b65-440f-bf88-b71184afa97b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:29.888922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a2891-4b65-440f-bf88-b71184afa97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:29.909848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-313a2891-4b65-440f-bf88-b71184afa97b None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:29.911111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-313a2891-4b65-440f-bf88-b71184afa97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:29.938847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:29.947288 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7faf0-0309-442c-a1a9-555327b8a002 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:29.989640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdbc9f-99b8-4853-8f64-2e17182f3e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:29.990235 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdbc9f-99b8-4853-8f64-2e17182f3e53 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:29.990520 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdbc9f-99b8-4853-8f64-2e17182f3e53 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:29.990789 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdbc9f-99b8-4853-8f64-2e17182f3e53 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:29.991634 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdbc9f-99b8-4853-8f64-2e17182f3e53 None admin] RBAC: Adding query filter params (name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:29.991940 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdbc9f-99b8-4853-8f64-2e17182f3e53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:29.993910 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdbc9f-99b8-4853-8f64-2e17182f3e53 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:30.004189 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 244/484] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:30.005884 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a2891-4b65-440f-bf88-b71184afa97b None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:30.012554 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 241/485] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:01:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:30.012554 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdbc9f-99b8-4853-8f64-2e17182f3e53 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:30.115174 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:30.122374 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a2891-4b65-440f-bf88-b71184afa97b None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:30.130808 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdbc9f-99b8-4853-8f64-2e17182f3e53 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:30.161122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84215a2-6775-4b67-aeaa-ef0ca666709e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:30.162080 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84215a2-6775-4b67-aeaa-ef0ca666709e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:30.162537 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84215a2-6775-4b67-aeaa-ef0ca666709e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:30.162985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84215a2-6775-4b67-aeaa-ef0ca666709e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:30.167861 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f98fc-4459-43e4-8402-8a9096aee357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:30.168485 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f98fc-4459-43e4-8402-8a9096aee357 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:30.168768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f98fc-4459-43e4-8402-8a9096aee357 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:30.169043 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f98fc-4459-43e4-8402-8a9096aee357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:30.174398 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84215a2-6775-4b67-aeaa-ef0ca666709e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-c84215a2-6775-4b67-aeaa-ef0ca666709e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:30.179690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:30.180572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:30.181440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:30.181440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:30.181440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:30.181440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:30.181440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:30.181440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:30.181440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:30.181440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:30.181440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:30.181440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:30.181440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:30.181440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:30.182036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f98fc-4459-43e4-8402-8a9096aee357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:30.182036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f98fc-4459-43e4-8402-8a9096aee357 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:30.182749 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 245/486] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:30.187320 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84215a2-6775-4b67-aeaa-ef0ca666709e None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-712f98fc-4459-43e4-8402-8a9096aee357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:30.197036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:30.197962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:30.199080 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:30.199080 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:30.199080 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:30.201266 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:30.203176 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 242/487] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:30.203913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f98fc-4459-43e4-8402-8a9096aee357 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:30.287714 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84215a2-6775-4b67-aeaa-ef0ca666709e None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:30.309827 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f98fc-4459-43e4-8402-8a9096aee357 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:30.322943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ae27a-0930-42db-a135-d059e1f08e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:30.323854 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ae27a-0930-42db-a135-d059e1f08e70 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:30.324135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ae27a-0930-42db-a135-d059e1f08e70 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:30.324409 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ae27a-0930-42db-a135-d059e1f08e70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:30.335303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ae27a-0930-42db-a135-d059e1f08e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-200ae27a-0930-42db-a135-d059e1f08e70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:30.339937 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:30.340845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:30.341630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:30.341630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:30.341630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:30.341630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:30.341630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:30.341630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:30.341630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:30.341630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:30.341630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:30.341630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:30.341630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:30.341630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:30.341630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 246/488] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:30.342287 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ae27a-0930-42db-a135-d059e1f08e70 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:30.352250 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd6fd-0ee6-48b5-bc8d-c4502c77227d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:30.352856 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd6fd-0ee6-48b5-bc8d-c4502c77227d None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:30.353135 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd6fd-0ee6-48b5-bc8d-c4502c77227d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:30.353416 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd6fd-0ee6-48b5-bc8d-c4502c77227d None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:30.354078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdd6fd-0ee6-48b5-bc8d-c4502c77227d None admin] RBAC: Adding query filter params (name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:30.354384 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdd6fd-0ee6-48b5-bc8d-c4502c77227d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:30.355796 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdd6fd-0ee6-48b5-bc8d-c4502c77227d None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:30.361384 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:30.370369 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 243/489] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:01:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:30.371171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd6fd-0ee6-48b5-bc8d-c4502c77227d None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:30.419065 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:30.444706 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ae27a-0930-42db-a135-d059e1f08e70 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:30.473672 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd6fd-0ee6-48b5-bc8d-c4502c77227d None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:30.480356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d161a0b-cc7a-46e4-9c50-dd5acda9b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:30.481166 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d161a0b-cc7a-46e4-9c50-dd5acda9b185 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:30.481550 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d161a0b-cc7a-46e4-9c50-dd5acda9b185 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:30.481950 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d161a0b-cc7a-46e4-9c50-dd5acda9b185 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:30.482909 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d161a0b-cc7a-46e4-9c50-dd5acda9b185 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:30.483286 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d161a0b-cc7a-46e4-9c50-dd5acda9b185 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:30.484693 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d161a0b-cc7a-46e4-9c50-dd5acda9b185 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:30.496213 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 247/490] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:30.497016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d161a0b-cc7a-46e4-9c50-dd5acda9b185 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:30.513634 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fecaf-d820-4e04-8355-ece5678b5abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:30.514238 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fecaf-d820-4e04-8355-ece5678b5abb None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:30.514517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fecaf-d820-4e04-8355-ece5678b5abb None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:30.514786 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fecaf-d820-4e04-8355-ece5678b5abb None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:30.515491 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fecaf-d820-4e04-8355-ece5678b5abb None admin] RBAC: Adding query filter params (name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:30.515794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fecaf-d820-4e04-8355-ece5678b5abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:30.517152 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fecaf-d820-4e04-8355-ece5678b5abb None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:30.525803 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 244/491] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:01:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:30.525803 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fecaf-d820-4e04-8355-ece5678b5abb None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:30.586907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:30.603636 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d161a0b-cc7a-46e4-9c50-dd5acda9b185 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:30.626303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fecaf-d820-4e04-8355-ece5678b5abb None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:30.637305 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6f7da-8499-4989-ad84-73020a89bb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:30.637932 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6f7da-8499-4989-ad84-73020a89bb4b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:30.638205 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6f7da-8499-4989-ad84-73020a89bb4b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:30.638474 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6f7da-8499-4989-ad84-73020a89bb4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:30.640275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:30.650117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6f7da-8499-4989-ad84-73020a89bb4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-c4e6f7da-8499-4989-ad84-73020a89bb4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:30.655121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:30.656118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:30.656931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:30.656931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:30.656931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:30.656931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:30.656931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:30.656931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:30.656931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:30.656931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:30.656931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:30.656931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:30.656931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:30.656931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:30.656931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 248/492] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:30.657794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6f7da-8499-4989-ad84-73020a89bb4b None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:30.666376 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efc7c3-ea31-4c61-a9f2-8140d1e0e833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:30.667002 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efc7c3-ea31-4c61-a9f2-8140d1e0e833 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:30.667322 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efc7c3-ea31-4c61-a9f2-8140d1e0e833 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:30.667596 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efc7c3-ea31-4c61-a9f2-8140d1e0e833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:30.677899 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efc7c3-ea31-4c61-a9f2-8140d1e0e833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:30.679504 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efc7c3-ea31-4c61-a9f2-8140d1e0e833 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-a5efc7c3-ea31-4c61-a9f2-8140d1e0e833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:30.693157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:30.694067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:30.694927 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:30.694927 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:30.694927 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:30.694927 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 245/493] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:30.695142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efc7c3-ea31-4c61-a9f2-8140d1e0e833 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:30.757264 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6f7da-8499-4989-ad84-73020a89bb4b None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:30.790890 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676391-c9e0-4465-a2c0-c1b922f067d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:30.791538 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676391-c9e0-4465-a2c0-c1b922f067d8 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:30.791820 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676391-c9e0-4465-a2c0-c1b922f067d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:30.792093 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676391-c9e0-4465-a2c0-c1b922f067d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:30.793101 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efc7c3-ea31-4c61-a9f2-8140d1e0e833 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:30.799598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23676391-c9e0-4465-a2c0-c1b922f067d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:30.801044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23676391-c9e0-4465-a2c0-c1b922f067d8 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:30.806159 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-23676391-c9e0-4465-a2c0-c1b922f067d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:30.813936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:30.814934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:30.815848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:30.815848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:30.815848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:30.815848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:30.815848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:30.815848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:30.815848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:30.815848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:30.815848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:01:30.815848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:30.815848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 249/494] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Aug 18 21:01:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:30.816416 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676391-c9e0-4465-a2c0-c1b922f067d8 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:30.831519 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a5381-2681-4ccb-bc4a-ac8d378817b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:30.832155 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a5381-2681-4ccb-bc4a-ac8d378817b9 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:30.832432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a5381-2681-4ccb-bc4a-ac8d378817b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:30.833211 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a5381-2681-4ccb-bc4a-ac8d378817b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:30.843617 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a5381-2681-4ccb-bc4a-ac8d378817b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:30.845242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a5381-2681-4ccb-bc4a-ac8d378817b9 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-313a5381-2681-4ccb-bc4a-ac8d378817b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:30.859698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:30.860667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:30.861510 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:30.861510 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:30.861510 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:30.861510 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 246/495] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:30.861510 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a5381-2681-4ccb-bc4a-ac8d378817b9 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:30.875413 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:30.919082 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676391-c9e0-4465-a2c0-c1b922f067d8 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:30.951748 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78900d36-ffd0-4feb-b807-c7db9bc50d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:30.952345 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78900d36-ffd0-4feb-b807-c7db9bc50d67 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:30.952623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78900d36-ffd0-4feb-b807-c7db9bc50d67 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:30.952891 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78900d36-ffd0-4feb-b807-c7db9bc50d67 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:30.953538 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78900d36-ffd0-4feb-b807-c7db9bc50d67 None admin] RBAC: Adding query filter params (name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:30.953838 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78900d36-ffd0-4feb-b807-c7db9bc50d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:30.955206 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78900d36-ffd0-4feb-b807-c7db9bc50d67 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:30.959550 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a5381-2681-4ccb-bc4a-ac8d378817b9 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:30.962992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 250/496] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:01:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:30.963612 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78900d36-ffd0-4feb-b807-c7db9bc50d67 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:30.995065 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72e2e2-825e-4b11-99a1-c1158e25e22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:30.995687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72e2e2-825e-4b11-99a1-c1158e25e22f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:30.995962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72e2e2-825e-4b11-99a1-c1158e25e22f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:30.996240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72e2e2-825e-4b11-99a1-c1158e25e22f None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:30.996862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72e2e2-825e-4b11-99a1-c1158e25e22f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:30.997162 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72e2e2-825e-4b11-99a1-c1158e25e22f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:30.998519 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72e2e2-825e-4b11-99a1-c1158e25e22f None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:31.016723 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 247/497] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:31.017754 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72e2e2-825e-4b11-99a1-c1158e25e22f None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:31.043996 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:31.065632 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78900d36-ffd0-4feb-b807-c7db9bc50d67 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:31.082386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:31.105307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5201e-52b9-4ba8-aaeb-cf0ec2810fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:31.105898 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5201e-52b9-4ba8-aaeb-cf0ec2810fcc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:31.106181 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5201e-52b9-4ba8-aaeb-cf0ec2810fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:31.106448 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5201e-52b9-4ba8-aaeb-cf0ec2810fcc None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:31.107159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5201e-52b9-4ba8-aaeb-cf0ec2810fcc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:31.107494 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5201e-52b9-4ba8-aaeb-cf0ec2810fcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:31.108934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5201e-52b9-4ba8-aaeb-cf0ec2810fcc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:31.115229 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72e2e2-825e-4b11-99a1-c1158e25e22f None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:31.144233 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 251/498] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Aug 18 21:01:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:31.144961 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5201e-52b9-4ba8-aaeb-cf0ec2810fcc None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:31.149341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf2def-edd0-4a3f-adf5-7e03cef93403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:31.149948 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf2def-edd0-4a3f-adf5-7e03cef93403 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:31.150231 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf2def-edd0-4a3f-adf5-7e03cef93403 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:31.150501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf2def-edd0-4a3f-adf5-7e03cef93403 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:31.151133 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf2def-edd0-4a3f-adf5-7e03cef93403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:31.151470 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf2def-edd0-4a3f-adf5-7e03cef93403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:31.152829 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf2def-edd0-4a3f-adf5-7e03cef93403 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:31.164262 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 248/499] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:31.165045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf2def-edd0-4a3f-adf5-7e03cef93403 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:31.244942 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5201e-52b9-4ba8-aaeb-cf0ec2810fcc None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:31.248753 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:31.263156 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf2def-edd0-4a3f-adf5-7e03cef93403 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:31.278206 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab043d9b-9d38-4eb9-911f-c74f17fb06d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:31.278821 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab043d9b-9d38-4eb9-911f-c74f17fb06d2 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:31.279096 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab043d9b-9d38-4eb9-911f-c74f17fb06d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:31.279394 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab043d9b-9d38-4eb9-911f-c74f17fb06d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:31.289510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab043d9b-9d38-4eb9-911f-c74f17fb06d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:31.290964 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab043d9b-9d38-4eb9-911f-c74f17fb06d2 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:31.297043 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4770f26-37ba-494b-b2ed-051c02d2b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:31.297653 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4770f26-37ba-494b-b2ed-051c02d2b18c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:31.297932 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4770f26-37ba-494b-b2ed-051c02d2b18c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:31.298204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4770f26-37ba-494b-b2ed-051c02d2b18c None admin] PATH_INFO: `/v3/users/glance` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-ab043d9b-9d38-4eb9-911f-c74f17fb06d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:31.305651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:31.306541 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:31.307794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:31.307794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:31.307794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:31.307959 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4770f26-37ba-494b-b2ed-051c02d2b18c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:31.308043 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 252/500] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:31.308111 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4770f26-37ba-494b-b2ed-051c02d2b18c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:31.308176 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab043d9b-9d38-4eb9-911f-c74f17fb06d2 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-a4770f26-37ba-494b-b2ed-051c02d2b18c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:31.321526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:31.322443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:31.323654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:31.323654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:31.323654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:31.323654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:31.323654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:31.323654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:31.323654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:31.323654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:31.323654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 21:01:31.323654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:31.323654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 249/501] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:31.323654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4770f26-37ba-494b-b2ed-051c02d2b18c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:31.338399 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:31.412024 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab043d9b-9d38-4eb9-911f-c74f17fb06d2 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:31.426076 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4770f26-37ba-494b-b2ed-051c02d2b18c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:31.444633 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64065a-77cf-4c39-b959-83acfe754ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:31.445226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64065a-77cf-4c39-b959-83acfe754ccc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:31.445502 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64065a-77cf-4c39-b959-83acfe754ccc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:31.445767 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64065a-77cf-4c39-b959-83acfe754ccc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:31.458619 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ed833-a344-4f1a-83ee-a4fb32ff4052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:31.459233 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ed833-a344-4f1a-83ee-a4fb32ff4052 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:31.459548 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ed833-a344-4f1a-83ee-a4fb32ff4052 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:31.459816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ed833-a344-4f1a-83ee-a4fb32ff4052 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:31.466989 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ed833-a344-4f1a-83ee-a4fb32ff4052 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:31.468489 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ed833-a344-4f1a-83ee-a4fb32ff4052 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-654ed833-a344-4f1a-83ee-a4fb32ff4052 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:31.479992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:31.480913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:31.481791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:31.481791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:31.481791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:31.481791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:31.481791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:31.481791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:31.481791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:31.481791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:31.481791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:01:31.481791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:31.481791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 250/502] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:31.482351 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ed833-a344-4f1a-83ee-a4fb32ff4052 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:31.490665 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:31.516244 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64065a-77cf-4c39-b959-83acfe754ccc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:31.517606 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64065a-77cf-4c39-b959-83acfe754ccc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:31.545579 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:31.585245 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ed833-a344-4f1a-83ee-a4fb32ff4052 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:31.620907 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 253/503] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:31.621755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64065a-77cf-4c39-b959-83acfe754ccc None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:31.624128 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bf1a2-22ba-4bdc-8a8c-144993f3d057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:31.624733 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bf1a2-22ba-4bdc-8a8c-144993f3d057 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:31.625013 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bf1a2-22ba-4bdc-8a8c-144993f3d057 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:31.625419 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bf1a2-22ba-4bdc-8a8c-144993f3d057 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:31.625923 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bf1a2-22ba-4bdc-8a8c-144993f3d057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:31.626224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bf1a2-22ba-4bdc-8a8c-144993f3d057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:31.627632 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bf1a2-22ba-4bdc-8a8c-144993f3d057 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:31.640090 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 251/504] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:31.640927 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bf1a2-22ba-4bdc-8a8c-144993f3d057 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:31.704740 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:31.724961 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64065a-77cf-4c39-b959-83acfe754ccc None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:31.738718 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bf1a2-22ba-4bdc-8a8c-144993f3d057 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:31.750009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:31.758880 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27dc8c-7016-412d-8b04-78b63016562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:31.759511 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27dc8c-7016-412d-8b04-78b63016562a None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:31.759791 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27dc8c-7016-412d-8b04-78b63016562a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:31.760064 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27dc8c-7016-412d-8b04-78b63016562a None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:31.760776 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27dc8c-7016-412d-8b04-78b63016562a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:31.761081 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27dc8c-7016-412d-8b04-78b63016562a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:31.762519 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27dc8c-7016-412d-8b04-78b63016562a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:31.773020 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28423f15-9b1b-4d61-8d05-c5b172eb1adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:31.773613 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423f15-9b1b-4d61-8d05-c5b172eb1adb None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:31.773893 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423f15-9b1b-4d61-8d05-c5b172eb1adb None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:31.774164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423f15-9b1b-4d61-8d05-c5b172eb1adb None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:31.774873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28423f15-9b1b-4d61-8d05-c5b172eb1adb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:31.775177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28423f15-9b1b-4d61-8d05-c5b172eb1adb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:31.776665 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28423f15-9b1b-4d61-8d05-c5b172eb1adb None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:31.778972 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 254/505] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Aug 18 21:01:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:31.779808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27dc8c-7016-412d-8b04-78b63016562a None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:31.813334 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 252/506] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Aug 18 21:01:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:31.816239 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28423f15-9b1b-4d61-8d05-c5b172eb1adb None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:31.878303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27dc8c-7016-412d-8b04-78b63016562a None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:31.911838 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7aa26-7362-4241-ab9e-255e2a1307c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:31.912453 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7aa26-7362-4241-ab9e-255e2a1307c9 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:31.912702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28423f15-9b1b-4d61-8d05-c5b172eb1adb None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:31.912801 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7aa26-7362-4241-ab9e-255e2a1307c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:31.912983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7aa26-7362-4241-ab9e-255e2a1307c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:31.922685 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7aa26-7362-4241-ab9e-255e2a1307c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:31.924259 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7aa26-7362-4241-ab9e-255e2a1307c9 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:31.936090 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-49d7aa26-7362-4241-ab9e-255e2a1307c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:31.938486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:31.939516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:31.940352 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:31.940352 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:31.940352 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:31.940352 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 255/507] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:31.940559 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7aa26-7362-4241-ab9e-255e2a1307c9 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:31.952726 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7b0f5-b6cd-4e25-9a06-68cf2ad53c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:31.953812 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7b0f5-b6cd-4e25-9a06-68cf2ad53c8f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:31.954091 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7b0f5-b6cd-4e25-9a06-68cf2ad53c8f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:31.954361 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7b0f5-b6cd-4e25-9a06-68cf2ad53c8f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:31.961885 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7b0f5-b6cd-4e25-9a06-68cf2ad53c8f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:31.963340 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7b0f5-b6cd-4e25-9a06-68cf2ad53c8f None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-bfb7b0f5-b6cd-4e25-9a06-68cf2ad53c8f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:31.974318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:31.975210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:31.976150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:31.976150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:31.976150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:31.976150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:31.976150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:31.976150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:31.976150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:31.976150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:31.976150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 21:01:31.976150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:31.976150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 253/508] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:31.976150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7b0f5-b6cd-4e25-9a06-68cf2ad53c8f None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:31.981638 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:32.047237 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7aa26-7362-4241-ab9e-255e2a1307c9 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:32.075365 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7b0f5-b6cd-4e25-9a06-68cf2ad53c8f None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:32.080466 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad06891-6d38-4d66-b4a2-95811ef9f585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:32.081061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad06891-6d38-4d66-b4a2-95811ef9f585 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:32.081339 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad06891-6d38-4d66-b4a2-95811ef9f585 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:32.081613 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad06891-6d38-4d66-b4a2-95811ef9f585 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:32.109193 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4638fd-94d9-46c9-be10-118fa3e7a670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:32.109788 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4638fd-94d9-46c9-be10-118fa3e7a670 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:32.110067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4638fd-94d9-46c9-be10-118fa3e7a670 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:32.110339 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4638fd-94d9-46c9-be10-118fa3e7a670 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:32.147914 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad06891-6d38-4d66-b4a2-95811ef9f585 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:32.149368 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad06891-6d38-4d66-b4a2-95811ef9f585 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:32.162644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:32.178755 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4638fd-94d9-46c9-be10-118fa3e7a670 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:32.180252 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4638fd-94d9-46c9-be10-118fa3e7a670 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:32.181238 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:32.246152 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 256/509] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:32.247034 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad06891-6d38-4d66-b4a2-95811ef9f585 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:32.278323 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 254/510] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:32.279759 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4638fd-94d9-46c9-be10-118fa3e7a670 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:32.342233 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad06891-6d38-4d66-b4a2-95811ef9f585 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:32.363116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:32.374417 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02e42f-41d5-4a18-b6b7-ea89b1dcca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:32.375011 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e42f-41d5-4a18-b6b7-ea89b1dcca0d None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:32.375306 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e42f-41d5-4a18-b6b7-ea89b1dcca0d None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:32.375581 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e42f-41d5-4a18-b6b7-ea89b1dcca0d None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:32.376207 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02e42f-41d5-4a18-b6b7-ea89b1dcca0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:32.376509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02e42f-41d5-4a18-b6b7-ea89b1dcca0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:32.377866 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02e42f-41d5-4a18-b6b7-ea89b1dcca0d None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:32.378438 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4638fd-94d9-46c9-be10-118fa3e7a670 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:32.380790 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:32.389952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 257/511] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:32.390547 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02e42f-41d5-4a18-b6b7-ea89b1dcca0d None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:32.413783 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faab56d-8309-4939-8b80-989e5dfaabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:32.414408 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faab56d-8309-4939-8b80-989e5dfaabfb None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:32.414689 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faab56d-8309-4939-8b80-989e5dfaabfb None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:32.414960 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faab56d-8309-4939-8b80-989e5dfaabfb None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:32.415709 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faab56d-8309-4939-8b80-989e5dfaabfb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:32.416018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faab56d-8309-4939-8b80-989e5dfaabfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:32.417448 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faab56d-8309-4939-8b80-989e5dfaabfb None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:32.435038 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 255/512] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Aug 18 21:01:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:32.435897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faab56d-8309-4939-8b80-989e5dfaabfb None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:32.492264 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02e42f-41d5-4a18-b6b7-ea89b1dcca0d None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:32.525656 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f04068-a64e-4e1b-afd0-e8a30b2bffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:32.526267 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f04068-a64e-4e1b-afd0-e8a30b2bffa9 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:32.526547 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f04068-a64e-4e1b-afd0-e8a30b2bffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:32.526818 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f04068-a64e-4e1b-afd0-e8a30b2bffa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:32.532709 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faab56d-8309-4939-8b80-989e5dfaabfb None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:32.537569 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f04068-a64e-4e1b-afd0-e8a30b2bffa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:32.539014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f04068-a64e-4e1b-afd0-e8a30b2bffa9 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-02f04068-a64e-4e1b-afd0-e8a30b2bffa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:32.553535 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:32.554510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:32.555398 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:32.555398 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:32.555398 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:32.555398 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 258/513] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:32.556019 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f04068-a64e-4e1b-afd0-e8a30b2bffa9 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:32.570890 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516916-2bff-4def-a852-32fb8f1f3301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:32.571555 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516916-2bff-4def-a852-32fb8f1f3301 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:32.571849 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516916-2bff-4def-a852-32fb8f1f3301 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:32.572125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516916-2bff-4def-a852-32fb8f1f3301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:32.582313 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd516916-2bff-4def-a852-32fb8f1f3301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:32.584553 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd516916-2bff-4def-a852-32fb8f1f3301 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:32.586406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-dd516916-2bff-4def-a852-32fb8f1f3301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:32.600482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:32.601657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:32.602681 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:32.602681 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:32.602681 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:32.602681 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 256/514] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:32.602681 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516916-2bff-4def-a852-32fb8f1f3301 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:32.610266 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:32.661804 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f04068-a64e-4e1b-afd0-e8a30b2bffa9 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:32.696468 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c42a5d-e015-441e-86b4-421c816efce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:32.697093 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c42a5d-e015-441e-86b4-421c816efce6 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:32.697398 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c42a5d-e015-441e-86b4-421c816efce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:32.697677 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c42a5d-e015-441e-86b4-421c816efce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:32.703432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516916-2bff-4def-a852-32fb8f1f3301 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:32.704426 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c42a5d-e015-441e-86b4-421c816efce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:32.705882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c42a5d-e015-441e-86b4-421c816efce6 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-f0c42a5d-e015-441e-86b4-421c816efce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:32.717360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:32.718204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:32.719061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:32.719061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:32.719061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:32.719061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:32.719061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:32.719061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:32.719061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:32.719061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:32.719061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 259/515] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:32.720061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c42a5d-e015-441e-86b4-421c816efce6 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:32.743515 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde1e48-3f21-4f68-9137-1b597cad806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:32.744114 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde1e48-3f21-4f68-9137-1b597cad806c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:32.744402 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde1e48-3f21-4f68-9137-1b597cad806c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:32.744671 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde1e48-3f21-4f68-9137-1b597cad806c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:32.804794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:32.812828 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde1e48-3f21-4f68-9137-1b597cad806c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:32.814298 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde1e48-3f21-4f68-9137-1b597cad806c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:32.822496 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c42a5d-e015-441e-86b4-421c816efce6 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:32.831353 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:32.856014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945bdbc-8b3e-4371-baf7-a93e9e3b5f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:32.856543 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945bdbc-8b3e-4371-baf7-a93e9e3b5f3e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:32.856824 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945bdbc-8b3e-4371-baf7-a93e9e3b5f3e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:32.857095 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945bdbc-8b3e-4371-baf7-a93e9e3b5f3e None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:32.857721 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945bdbc-8b3e-4371-baf7-a93e9e3b5f3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:32.858021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945bdbc-8b3e-4371-baf7-a93e9e3b5f3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:32.859420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945bdbc-8b3e-4371-baf7-a93e9e3b5f3e None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:32.871243 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 260/516] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:32.872061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945bdbc-8b3e-4371-baf7-a93e9e3b5f3e None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:32.911655 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 257/517] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:32.912494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde1e48-3f21-4f68-9137-1b597cad806c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:32.969791 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945bdbc-8b3e-4371-baf7-a93e9e3b5f3e None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:33.003160 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929e80b-8963-4347-bc4d-fcb872063df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:33.003797 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929e80b-8963-4347-bc4d-fcb872063df5 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:33.004010 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:33.004111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929e80b-8963-4347-bc4d-fcb872063df5 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:33.004907 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929e80b-8963-4347-bc4d-fcb872063df5 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:33.005588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929e80b-8963-4347-bc4d-fcb872063df5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:33.005926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929e80b-8963-4347-bc4d-fcb872063df5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:33.007549 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929e80b-8963-4347-bc4d-fcb872063df5 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:33.011924 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde1e48-3f21-4f68-9137-1b597cad806c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:33.018357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 261/518] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:33.019184 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929e80b-8963-4347-bc4d-fcb872063df5 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:33.046067 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:33.050645 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcd66f-513a-42a9-bff6-249c259d5d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:33.051829 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcd66f-513a-42a9-bff6-249c259d5d95 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:33.052107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcd66f-513a-42a9-bff6-249c259d5d95 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:33.052373 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcd66f-513a-42a9-bff6-249c259d5d95 None admin] PATH_INFO: `/v3/projects` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:33.053047 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcd66f-513a-42a9-bff6-249c259d5d95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:33.053348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcd66f-513a-42a9-bff6-249c259d5d95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:33.054789 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcd66f-513a-42a9-bff6-249c259d5d95 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:33.072528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 258/519] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:33.073587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcd66f-513a-42a9-bff6-249c259d5d95 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:33.121916 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929e80b-8963-4347-bc4d-fcb872063df5 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:33.157301 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac78d7-5cb6-4fba-9ad5-5ec3fd97571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:33.157920 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac78d7-5cb6-4fba-9ad5-5ec3fd97571a None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:33.158205 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac78d7-5cb6-4fba-9ad5-5ec3fd97571a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:33.158479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac78d7-5cb6-4fba-9ad5-5ec3fd97571a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:33.165487 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac78d7-5cb6-4fba-9ad5-5ec3fd97571a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:33.166927 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac78d7-5cb6-4fba-9ad5-5ec3fd97571a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:33.172038 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcd66f-513a-42a9-bff6-249c259d5d95 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-46ac78d7-5cb6-4fba-9ad5-5ec3fd97571a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:33.178400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:33.179423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:33.180275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:33.180275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:33.180275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:33.180275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:33.180275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:33.180275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:33.180275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:33.180275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:33.180275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 262/520] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:33.180275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac78d7-5cb6-4fba-9ad5-5ec3fd97571a None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:33.208386 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1d7d1-986f-4261-bdd4-eef884ad0290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:33.209109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1d7d1-986f-4261-bdd4-eef884ad0290 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:33.209395 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1d7d1-986f-4261-bdd4-eef884ad0290 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:33.209669 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1d7d1-986f-4261-bdd4-eef884ad0290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:33.219715 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1d7d1-986f-4261-bdd4-eef884ad0290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:33.221145 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1d7d1-986f-4261-bdd4-eef884ad0290 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-e2e1d7d1-986f-4261-bdd4-eef884ad0290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:33.236143 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:33.237166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:33.238018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:33.238018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:33.238018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:33.238018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 259/521] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:33.238018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1d7d1-986f-4261-bdd4-eef884ad0290 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:33.246905 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:33.272011 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:33.285882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac78d7-5cb6-4fba-9ad5-5ec3fd97571a None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:33.319423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11173b6f-7f1b-4445-aeec-b62517f6ac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:33.320038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11173b6f-7f1b-4445-aeec-b62517f6ac7b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:33.320316 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11173b6f-7f1b-4445-aeec-b62517f6ac7b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:33.320586 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11173b6f-7f1b-4445-aeec-b62517f6ac7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:33.327826 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11173b6f-7f1b-4445-aeec-b62517f6ac7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:33.329702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11173b6f-7f1b-4445-aeec-b62517f6ac7b None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:33.340219 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1d7d1-986f-4261-bdd4-eef884ad0290 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-11173b6f-7f1b-4445-aeec-b62517f6ac7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:33.341045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:33.341936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:33.342784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:33.342784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:33.342784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:33.342784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:33.342784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:33.342784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:33.342784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:33.342784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:33.342784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 263/522] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:33.343240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11173b6f-7f1b-4445-aeec-b62517f6ac7b None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:33.377930 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f0a85-fb38-4c6e-aeff-174904d1a6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:33.378451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f0a85-fb38-4c6e-aeff-174904d1a6a7 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:33.378729 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f0a85-fb38-4c6e-aeff-174904d1a6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:33.378999 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f0a85-fb38-4c6e-aeff-174904d1a6a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:33.380254 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f0a85-fb38-4c6e-aeff-174904d1a6a7 None admin] RBAC: Adding query filter params (role.id=c1a49401a509407295b9fff1cf635344, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=ba197525d2af40528f7cbe7de9da9a23) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:33.380563 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f0a85-fb38-4c6e-aeff-174904d1a6a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:33.382012 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f0a85-fb38-4c6e-aeff-174904d1a6a7 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:33.387298 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 260/523] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:01:33 2022] GET /identity/v3/role_assignments?user.id=ba197525d2af40528f7cbe7de9da9a23&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=c1a49401a509407295b9fff1cf635344 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:33.388064 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f0a85-fb38-4c6e-aeff-174904d1a6a7 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:33.446026 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11173b6f-7f1b-4445-aeec-b62517f6ac7b None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:33.468734 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:33.487520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a76ce-4646-42c6-9991-817982655ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:33.488141 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a76ce-4646-42c6-9991-817982655ae3 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:33.488411 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a76ce-4646-42c6-9991-817982655ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:33.489405 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a76ce-4646-42c6-9991-817982655ae3 None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:33.489995 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a76ce-4646-42c6-9991-817982655ae3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:33.490310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a76ce-4646-42c6-9991-817982655ae3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:33.491798 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a76ce-4646-42c6-9991-817982655ae3 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:33.508544 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f0a85-fb38-4c6e-aeff-174904d1a6a7 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:33.510564 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 264/524] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:33.511533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a76ce-4646-42c6-9991-817982655ae3 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:33.524309 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:33.560759 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a3967-67e7-47ba-8f66-96718ab2efb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:33.561316 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a3967-67e7-47ba-8f66-96718ab2efb0 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:33.561594 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a3967-67e7-47ba-8f66-96718ab2efb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:33.561861 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a3967-67e7-47ba-8f66-96718ab2efb0 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:33.562585 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a3967-67e7-47ba-8f66-96718ab2efb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:33.562789 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a3967-67e7-47ba-8f66-96718ab2efb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:33.564184 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a3967-67e7-47ba-8f66-96718ab2efb0 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:33.580692 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 261/525] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:33.581563 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a3967-67e7-47ba-8f66-96718ab2efb0 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:33.635107 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a76ce-4646-42c6-9991-817982655ae3 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:33.670267 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a398b1-05cc-4675-8743-d03e0b13c289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:33.671132 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a398b1-05cc-4675-8743-d03e0b13c289 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:33.671602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a398b1-05cc-4675-8743-d03e0b13c289 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:33.672031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a398b1-05cc-4675-8743-d03e0b13c289 None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:33.672785 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a398b1-05cc-4675-8743-d03e0b13c289 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:33.673096 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a398b1-05cc-4675-8743-d03e0b13c289 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:33.674590 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a398b1-05cc-4675-8743-d03e0b13c289 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:33.691415 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 265/526] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:33.693484 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a398b1-05cc-4675-8743-d03e0b13c289 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:33.698471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a3967-67e7-47ba-8f66-96718ab2efb0 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:33.729312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:33.736352 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf4205-a428-4cc8-b583-de461a8f4daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:33.736817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf4205-a428-4cc8-b583-de461a8f4daa None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:33.737097 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf4205-a428-4cc8-b583-de461a8f4daa None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:33.737370 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf4205-a428-4cc8-b583-de461a8f4daa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:33.738259 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf4205-a428-4cc8-b583-de461a8f4daa None admin] RBAC: Adding query filter params (role.id=c1a49401a509407295b9fff1cf635344, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=255b174cea9f41f6970978c44bec2b8f) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:33.739175 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf4205-a428-4cc8-b583-de461a8f4daa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:33.740092 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf4205-a428-4cc8-b583-de461a8f4daa None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:33.746472 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 262/527] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:01:33 2022] GET /identity/v3/role_assignments?user.id=255b174cea9f41f6970978c44bec2b8f&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=c1a49401a509407295b9fff1cf635344 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:33.747137 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf4205-a428-4cc8-b583-de461a8f4daa None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:33.784828 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:33.831682 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a398b1-05cc-4675-8743-d03e0b13c289 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:33.871603 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009125e8-9f45-4a71-a544-1d1e0ddfd30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:33.872301 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009125e8-9f45-4a71-a544-1d1e0ddfd30b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:33.872745 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009125e8-9f45-4a71-a544-1d1e0ddfd30b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:33.873338 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009125e8-9f45-4a71-a544-1d1e0ddfd30b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:33.881950 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009125e8-9f45-4a71-a544-1d1e0ddfd30b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:33.883403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009125e8-9f45-4a71-a544-1d1e0ddfd30b None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:33.887663 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf4205-a428-4cc8-b583-de461a8f4daa None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-009125e8-9f45-4a71-a544-1d1e0ddfd30b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:33.895952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:33.896858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:33.898131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:33.898131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:33.898131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:33.898131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:33.898131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:33.898131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:33.898131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:33.898131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:33.898131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 266/528] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:33.903205 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009125e8-9f45-4a71-a544-1d1e0ddfd30b None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:33.936141 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a4cfa-403b-4a94-ba18-3c55593e60ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:33.937124 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a4cfa-403b-4a94-ba18-3c55593e60ad None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:33.937608 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a4cfa-403b-4a94-ba18-3c55593e60ad None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:33.938083 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a4cfa-403b-4a94-ba18-3c55593e60ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:33.939004 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a4cfa-403b-4a94-ba18-3c55593e60ad None admin] RBAC: Adding query filter params (role.id=c1a49401a509407295b9fff1cf635344, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=3510dd48a215455fb55bfbec820c7f3c) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:33.939565 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a4cfa-403b-4a94-ba18-3c55593e60ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:33.941238 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a4cfa-403b-4a94-ba18-3c55593e60ad None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:33.952839 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 263/529] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:01:33 2022] GET /identity/v3/role_assignments?user.id=3510dd48a215455fb55bfbec820c7f3c&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=c1a49401a509407295b9fff1cf635344 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:34.024571 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009125e8-9f45-4a71-a544-1d1e0ddfd30b None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:34.058232 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:34.068434 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40ee38-9dd4-4236-b614-f7d4135e2b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:34.069069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40ee38-9dd4-4236-b614-f7d4135e2b13 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:34.069358 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40ee38-9dd4-4236-b614-f7d4135e2b13 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:34.069637 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40ee38-9dd4-4236-b614-f7d4135e2b13 None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:34.070352 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40ee38-9dd4-4236-b614-f7d4135e2b13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:34.070670 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40ee38-9dd4-4236-b614-f7d4135e2b13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:34.075366 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40ee38-9dd4-4236-b614-f7d4135e2b13 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:34.087291 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 267/530] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:34.093437 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a4cfa-403b-4a94-ba18-3c55593e60ad None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:34.160421 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:34.205069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a4cfa-403b-4a94-ba18-3c55593e60ad None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:34.242683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd69466-e8d8-49cf-a311-f7ba51a278ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:34.243307 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd69466-e8d8-49cf-a311-f7ba51a278ba None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:34.243597 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd69466-e8d8-49cf-a311-f7ba51a278ba None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:34.243872 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd69466-e8d8-49cf-a311-f7ba51a278ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:34.244590 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd69466-e8d8-49cf-a311-f7ba51a278ba None admin] RBAC: Adding query filter params (role.id=c1a49401a509407295b9fff1cf635344, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=b9326ebc83a2471a856f668ee77285c5) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:34.244898 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd69466-e8d8-49cf-a311-f7ba51a278ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:34.246336 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd69466-e8d8-49cf-a311-f7ba51a278ba None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:34.252471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 264/531] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:01:34 2022] GET /identity/v3/role_assignments?user.id=b9326ebc83a2471a856f668ee77285c5&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=c1a49401a509407295b9fff1cf635344 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:35.612425 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a3052-f0e6-46d3-8926-c3ba47fc1938 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:35.612929 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a3052-f0e6-46d3-8926-c3ba47fc1938 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:35.613010 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a3052-f0e6-46d3-8926-c3ba47fc1938 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:35.614593 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 268/532] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:35.619717 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20bf08-373c-4879-adfa-d9c53028bb9a None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:35.620111 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20bf08-373c-4879-adfa-d9c53028bb9a None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:35.620277 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20bf08-373c-4879-adfa-d9c53028bb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:35.639178 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-7d20bf08-373c-4879-adfa-d9c53028bb9a None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:35.640404 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-7d20bf08-373c-4879-adfa-d9c53028bb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:35.710358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 265/533] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:36.018149 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef003df8-73cc-475a-ad47-b8293430554c None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:36.018493 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef003df8-73cc-475a-ad47-b8293430554c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:36.018713 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef003df8-73cc-475a-ad47-b8293430554c None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:36.020384 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 269/534] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:36.025830 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05baae-878b-4289-ab49-e947083f0631 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:36.026348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05baae-878b-4289-ab49-e947083f0631 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:36.026822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05baae-878b-4289-ab49-e947083f0631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:36.046363 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef003df8-73cc-475a-ad47-b8293430554c None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:36.047549 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-ab05baae-878b-4289-ab49-e947083f0631 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:36.048795 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-ab05baae-878b-4289-ab49-e947083f0631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:36.114693 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:36.146745 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 266/535] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:36.172750 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef003df8-73cc-475a-ad47-b8293430554c None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:36.208076 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c58b4f-5493-4d91-a78f-ef3175f8668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:36.208711 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c58b4f-5493-4d91-a78f-ef3175f8668f None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:36.208991 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c58b4f-5493-4d91-a78f-ef3175f8668f None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:36.209260 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c58b4f-5493-4d91-a78f-ef3175f8668f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:36.212445 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e6bd5-3342-41ab-a144-8fbbbad1adb1 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:36.212734 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e6bd5-3342-41ab-a144-8fbbbad1adb1 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:36.213014 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e6bd5-3342-41ab-a144-8fbbbad1adb1 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:36.214596 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 267/536] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:36.219341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e0283-1998-4103-ab47-450c42847583 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:36.219630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e0283-1998-4103-ab47-450c42847583 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:36.219866 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c58b4f-5493-4d91-a78f-ef3175f8668f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:36.219971 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e0283-1998-4103-ab47-450c42847583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-17c58b4f-5493-4d91-a78f-ef3175f8668f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:36.225623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:36.226524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:36.227788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:36.227788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:36.227788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:36.227788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:36.227788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:36.227788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:36.227788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:36.227788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:36.227788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:36.227788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:36.227788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:36.227788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:36.227788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 270/537] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:01:36.233446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c58b4f-5493-4d91-a78f-ef3175f8668f None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:36.243127 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-f00e0283-1998-4103-ab47-450c42847583 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:36.244346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-f00e0283-1998-4103-ab47-450c42847583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:36.301686 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:36.335626 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 268/538] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:36.369182 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c58b4f-5493-4d91-a78f-ef3175f8668f None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:36.405376 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd21403-feb3-443a-9343-d73127e47cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:36.406322 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd21403-feb3-443a-9343-d73127e47cf9 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:36.406800 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd21403-feb3-443a-9343-d73127e47cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:36.407288 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd21403-feb3-443a-9343-d73127e47cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:36.408159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd21403-feb3-443a-9343-d73127e47cf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:36.408655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd21403-feb3-443a-9343-d73127e47cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:36.411122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd21403-feb3-443a-9343-d73127e47cf9 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:36.420479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 271/539] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:01:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:36.428460 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e0283-1998-4103-ab47-450c42847583 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:36.465852 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080f5c3-3373-43a7-a4f5-c2ff7b29d103 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:36.466182 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080f5c3-3373-43a7-a4f5-c2ff7b29d103 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:36.466410 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080f5c3-3373-43a7-a4f5-c2ff7b29d103 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:36.468481 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 272/540] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:01:36.476766 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf40164-6e1e-4f24-8c43-0e758a31c733 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:36.477156 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf40164-6e1e-4f24-8c43-0e758a31c733 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:36.477533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf40164-6e1e-4f24-8c43-0e758a31c733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:36.497410 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-edf40164-6e1e-4f24-8c43-0e758a31c733 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:36.498654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-edf40164-6e1e-4f24-8c43-0e758a31c733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:36.547082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e0283-1998-4103-ab47-450c42847583 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:36.562724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:36.579415 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 273/541] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:36.580650 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf40164-6e1e-4f24-8c43-0e758a31c733 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:36.592071 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ff762-4026-4808-b458-f241b3b63519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:36.592619 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ff762-4026-4808-b458-f241b3b63519 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:36.592900 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ff762-4026-4808-b458-f241b3b63519 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:36.593173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ff762-4026-4808-b458-f241b3b63519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:36.608765 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ff762-4026-4808-b458-f241b3b63519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:36.610396 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ff762-4026-4808-b458-f241b3b63519 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-a18ff762-4026-4808-b458-f241b3b63519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:36.627318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:36.628687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:36.630320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:36.630320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:36.630320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:36.637268 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 269/542] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:36.638324 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ff762-4026-4808-b458-f241b3b63519 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:36.639056 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:36.716931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf40164-6e1e-4f24-8c43-0e758a31c733 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:36.748899 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ff762-4026-4808-b458-f241b3b63519 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:36.752465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57767ed8-3812-45c7-8827-88dbc6e2a13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:36.753094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57767ed8-3812-45c7-8827-88dbc6e2a13e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:36.753379 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57767ed8-3812-45c7-8827-88dbc6e2a13e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:36.753655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57767ed8-3812-45c7-8827-88dbc6e2a13e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:36.765222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57767ed8-3812-45c7-8827-88dbc6e2a13e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-57767ed8-3812-45c7-8827-88dbc6e2a13e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:36.769953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:36.770840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:36.771688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:36.771688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:36.771688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:36.771688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:36.771688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:36.771688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:36.771688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:36.771688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:36.771688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:36.771688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:36.771688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:36.771688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:36.771688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 274/543] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:36.772353 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57767ed8-3812-45c7-8827-88dbc6e2a13e None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:36.789766 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79011c92-9437-4be2-8c7f-fa3b2f14ad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:36.790343 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79011c92-9437-4be2-8c7f-fa3b2f14ad03 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:36.790627 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79011c92-9437-4be2-8c7f-fa3b2f14ad03 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:36.790903 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79011c92-9437-4be2-8c7f-fa3b2f14ad03 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:36.791574 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79011c92-9437-4be2-8c7f-fa3b2f14ad03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:36.791882 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79011c92-9437-4be2-8c7f-fa3b2f14ad03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:36.793252 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79011c92-9437-4be2-8c7f-fa3b2f14ad03 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:36.810449 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 270/544] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:36.810449 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79011c92-9437-4be2-8c7f-fa3b2f14ad03 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:36.837380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:36.884634 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:36.888824 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57767ed8-3812-45c7-8827-88dbc6e2a13e None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:36.917013 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79011c92-9437-4be2-8c7f-fa3b2f14ad03 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:36.925244 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be80ec-7825-4c07-b5db-f4df494db414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:36.926437 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be80ec-7825-4c07-b5db-f4df494db414 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:36.926773 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be80ec-7825-4c07-b5db-f4df494db414 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:36.927048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be80ec-7825-4c07-b5db-f4df494db414 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:36.937581 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be80ec-7825-4c07-b5db-f4df494db414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-38be80ec-7825-4c07-b5db-f4df494db414 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:36.942332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:36.943467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 275/545] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:36.944254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be80ec-7825-4c07-b5db-f4df494db414 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:36.956158 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccefd71-da4f-4281-a027-d5694c704591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:36.956791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccefd71-da4f-4281-a027-d5694c704591 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:36.957128 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccefd71-da4f-4281-a027-d5694c704591 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:36.957405 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccefd71-da4f-4281-a027-d5694c704591 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:36.958063 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccefd71-da4f-4281-a027-d5694c704591 None admin] RBAC: Adding query filter params (name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:36.958365 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccefd71-da4f-4281-a027-d5694c704591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:36.959775 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccefd71-da4f-4281-a027-d5694c704591 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:36.967687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 271/546] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:01:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:36.968327 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccefd71-da4f-4281-a027-d5694c704591 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.042893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be80ec-7825-4c07-b5db-f4df494db414 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.053391 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:37.068098 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccefd71-da4f-4281-a027-d5694c704591 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.076208 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccab0d-1f28-4139-9040-28e1df5ebfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.076823 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccab0d-1f28-4139-9040-28e1df5ebfde None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.077104 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccab0d-1f28-4139-9040-28e1df5ebfde None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.077376 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccab0d-1f28-4139-9040-28e1df5ebfde None admin] PATH_INFO: `/v3/users/nova` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.084202 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccab0d-1f28-4139-9040-28e1df5ebfde None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:37.085628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccab0d-1f28-4139-9040-28e1df5ebfde None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-15ccab0d-1f28-4139-9040-28e1df5ebfde None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:37.097262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:37.098865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:37.099990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:37.099990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:37.099990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:37.099990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:37.099990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:37.099990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:37.099990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:37.099990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:37.099990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:01:37.099990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:37.099990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 276/547] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Aug 18 21:01:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:37.099990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccab0d-1f28-4139-9040-28e1df5ebfde None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.106402 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1da66d-53ad-48d9-a1f2-7b309892b80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.107034 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1da66d-53ad-48d9-a1f2-7b309892b80b None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.107337 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1da66d-53ad-48d9-a1f2-7b309892b80b None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.107613 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1da66d-53ad-48d9-a1f2-7b309892b80b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.118426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1da66d-53ad-48d9-a1f2-7b309892b80b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-ec1da66d-53ad-48d9-a1f2-7b309892b80b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:37.123560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:37.124517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:37.125514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:37.125514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:37.125514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:37.125514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:37.125514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:37.125514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:37.125514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:37.125514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:37.125514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:37.125514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:37.125514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:37.125514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:37.125514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 272/548] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:37.126227 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1da66d-53ad-48d9-a1f2-7b309892b80b None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.130344 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:37.211950 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccab0d-1f28-4139-9040-28e1df5ebfde None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.228898 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1da66d-53ad-48d9-a1f2-7b309892b80b None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.245753 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c17f7-5d39-4f54-afdf-755110ddc865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.246344 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c17f7-5d39-4f54-afdf-755110ddc865 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.246626 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c17f7-5d39-4f54-afdf-755110ddc865 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.246900 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c17f7-5d39-4f54-afdf-755110ddc865 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.247591 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c17f7-5d39-4f54-afdf-755110ddc865 None admin] RBAC: Adding query filter params (name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:37.247894 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c17f7-5d39-4f54-afdf-755110ddc865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:37.249259 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c17f7-5d39-4f54-afdf-755110ddc865 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:37.257024 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 277/549] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:01:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:37.257870 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c17f7-5d39-4f54-afdf-755110ddc865 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.262191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2a18b-707c-4b34-aa5a-a03bfe54cb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.262820 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2a18b-707c-4b34-aa5a-a03bfe54cb6e None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.263099 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2a18b-707c-4b34-aa5a-a03bfe54cb6e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.263405 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2a18b-707c-4b34-aa5a-a03bfe54cb6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.274673 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2a18b-707c-4b34-aa5a-a03bfe54cb6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:37.276141 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2a18b-707c-4b34-aa5a-a03bfe54cb6e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:37.282776 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-14e2a18b-707c-4b34-aa5a-a03bfe54cb6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:37.292851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:37.293920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:37.295086 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:37.295086 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:37.295086 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:37.296441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 273/550] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:37.297214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2a18b-707c-4b34-aa5a-a03bfe54cb6e None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.347514 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:37.366364 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c17f7-5d39-4f54-afdf-755110ddc865 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.395438 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2a18b-707c-4b34-aa5a-a03bfe54cb6e None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.398863 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c256f-1642-4e99-a413-3f7bac2aa8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.399495 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c256f-1642-4e99-a413-3f7bac2aa8e6 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.399779 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c256f-1642-4e99-a413-3f7bac2aa8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.400054 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c256f-1642-4e99-a413-3f7bac2aa8e6 None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.400766 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c256f-1642-4e99-a413-3f7bac2aa8e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:37.401071 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c256f-1642-4e99-a413-3f7bac2aa8e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:37.402513 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c256f-1642-4e99-a413-3f7bac2aa8e6 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:37.419216 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 278/551] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Aug 18 21:01:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:37.420043 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c256f-1642-4e99-a413-3f7bac2aa8e6 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.432986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0dd0b-2e62-4fd8-9f04-81eb177e14a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.433588 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0dd0b-2e62-4fd8-9f04-81eb177e14a1 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.433875 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0dd0b-2e62-4fd8-9f04-81eb177e14a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.434151 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0dd0b-2e62-4fd8-9f04-81eb177e14a1 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.434834 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0dd0b-2e62-4fd8-9f04-81eb177e14a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:37.435142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0dd0b-2e62-4fd8-9f04-81eb177e14a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:37.436535 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0dd0b-2e62-4fd8-9f04-81eb177e14a1 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:37.444937 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 274/552] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:01:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:37.445722 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0dd0b-2e62-4fd8-9f04-81eb177e14a1 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.505008 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:37.523192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c256f-1642-4e99-a413-3f7bac2aa8e6 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.546739 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0dd0b-2e62-4fd8-9f04-81eb177e14a1 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.556442 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aad242-839e-40b1-8d2a-116887f5be53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.557061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aad242-839e-40b1-8d2a-116887f5be53 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.557340 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aad242-839e-40b1-8d2a-116887f5be53 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.557612 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aad242-839e-40b1-8d2a-116887f5be53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.565878 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:37.568198 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aad242-839e-40b1-8d2a-116887f5be53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:37.570120 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aad242-839e-40b1-8d2a-116887f5be53 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:37.580253 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a861bc-e2d2-421f-b1d1-6e3da38196b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.580863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a861bc-e2d2-421f-b1d1-6e3da38196b9 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.581148 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a861bc-e2d2-421f-b1d1-6e3da38196b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.581419 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a861bc-e2d2-421f-b1d1-6e3da38196b9 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.582579 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a861bc-e2d2-421f-b1d1-6e3da38196b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:37.582881 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a861bc-e2d2-421f-b1d1-6e3da38196b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:37.584256 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a861bc-e2d2-421f-b1d1-6e3da38196b9 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-01aad242-839e-40b1-8d2a-116887f5be53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:37.585943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:37.586865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:37.587798 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:37.587798 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:37.587798 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:37.587798 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 279/553] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:37.588022 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aad242-839e-40b1-8d2a-116887f5be53 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.598549 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 275/554] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:37.599338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a861bc-e2d2-421f-b1d1-6e3da38196b9 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.693957 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aad242-839e-40b1-8d2a-116887f5be53 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.699511 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a861bc-e2d2-421f-b1d1-6e3da38196b9 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.719588 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:37.727852 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e9610-84cc-4727-9d9a-d49b603364cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.728468 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9610-84cc-4727-9d9a-d49b603364cf None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.728746 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9610-84cc-4727-9d9a-d49b603364cf None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.729010 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9610-84cc-4727-9d9a-d49b603364cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.734001 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb039a-5ded-4845-a4ec-d4f7e87742e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.734633 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb039a-5ded-4845-a4ec-d4f7e87742e2 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.734917 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb039a-5ded-4845-a4ec-d4f7e87742e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.735193 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb039a-5ded-4845-a4ec-d4f7e87742e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.739544 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e9610-84cc-4727-9d9a-d49b603364cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:37.741070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e9610-84cc-4727-9d9a-d49b603364cf None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:37.745301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb039a-5ded-4845-a4ec-d4f7e87742e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:37.746740 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb039a-5ded-4845-a4ec-d4f7e87742e2 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-d76e9610-84cc-4727-9d9a-d49b603364cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:37.757707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:37.758655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:37.759549 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:37.759549 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:37.759549 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:37.759968 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 280/555] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:37.761198 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e9610-84cc-4727-9d9a-d49b603364cf None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-1dcb039a-5ded-4845-a4ec-d4f7e87742e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:37.762051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:37.763105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:37.764253 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:37.764253 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:37.764253 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:37.767420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 276/556] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:37.768515 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb039a-5ded-4845-a4ec-d4f7e87742e2 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.810915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:37.866184 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb039a-5ded-4845-a4ec-d4f7e87742e2 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.866348 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e9610-84cc-4727-9d9a-d49b603364cf None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.899397 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48792c-64b7-4ac4-bd4b-48d6f112c078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.899664 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f416f-17f3-4a82-af4d-e7c0d7f21f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.900007 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48792c-64b7-4ac4-bd4b-48d6f112c078 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.900184 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f416f-17f3-4a82-af4d-e7c0d7f21f3c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.900301 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48792c-64b7-4ac4-bd4b-48d6f112c078 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.900475 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f416f-17f3-4a82-af4d-e7c0d7f21f3c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.900695 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48792c-64b7-4ac4-bd4b-48d6f112c078 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.900926 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f416f-17f3-4a82-af4d-e7c0d7f21f3c None admin] PATH_INFO: `/v3/users/glance` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.902904 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48792c-64b7-4ac4-bd4b-48d6f112c078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:37.903375 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48792c-64b7-4ac4-bd4b-48d6f112c078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:37.905844 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48792c-64b7-4ac4-bd4b-48d6f112c078 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:37.911419 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f416f-17f3-4a82-af4d-e7c0d7f21f3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:37.912844 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f416f-17f3-4a82-af4d-e7c0d7f21f3c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:37.918453 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 281/557] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:37.919404 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48792c-64b7-4ac4-bd4b-48d6f112c078 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-0d8f416f-17f3-4a82-af4d-e7c0d7f21f3c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:37.923873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:37.925026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:37.926561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:37.926561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:37.926561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:37.926561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:37.926561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:37.926561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:37.926561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:37.926561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:37.926561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 21:01:37.926561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:37.926561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 277/558] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:37.926561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f416f-17f3-4a82-af4d-e7c0d7f21f3c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.960476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:38.017632 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48792c-64b7-4ac4-bd4b-48d6f112c078 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.020465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:38.029983 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f416f-17f3-4a82-af4d-e7c0d7f21f3c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.054098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74103e7-84db-4adf-8a61-e55cfeb008d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.054701 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74103e7-84db-4adf-8a61-e55cfeb008d8 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.054982 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74103e7-84db-4adf-8a61-e55cfeb008d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.055274 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74103e7-84db-4adf-8a61-e55cfeb008d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.055924 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74103e7-84db-4adf-8a61-e55cfeb008d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:38.056230 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74103e7-84db-4adf-8a61-e55cfeb008d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.057647 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74103e7-84db-4adf-8a61-e55cfeb008d8 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:38.062677 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034a03f-3e3d-49f6-bc17-6022d42e7b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.063276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a03f-3e3d-49f6-bc17-6022d42e7b09 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.063572 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a03f-3e3d-49f6-bc17-6022d42e7b09 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.063843 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a03f-3e3d-49f6-bc17-6022d42e7b09 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.064460 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034a03f-3e3d-49f6-bc17-6022d42e7b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:38.064757 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034a03f-3e3d-49f6-bc17-6022d42e7b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.066092 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034a03f-3e3d-49f6-bc17-6022d42e7b09 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:38.068724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 282/559] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:38.069511 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74103e7-84db-4adf-8a61-e55cfeb008d8 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:38.078165 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 278/560] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:38.079179 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034a03f-3e3d-49f6-bc17-6022d42e7b09 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:38.171533 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:38.172509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74103e7-84db-4adf-8a61-e55cfeb008d8 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.180987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034a03f-3e3d-49f6-bc17-6022d42e7b09 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.208063 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7bb76-89f9-4042-9ab0-38331804abc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.208679 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7bb76-89f9-4042-9ab0-38331804abc8 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.208963 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7bb76-89f9-4042-9ab0-38331804abc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.209239 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7bb76-89f9-4042-9ab0-38331804abc8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.216670 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44e057-afcb-424d-bab7-ff72a8789c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.216860 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7bb76-89f9-4042-9ab0-38331804abc8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.217288 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44e057-afcb-424d-bab7-ff72a8789c83 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.217565 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44e057-afcb-424d-bab7-ff72a8789c83 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.217836 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44e057-afcb-424d-bab7-ff72a8789c83 None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.218289 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7bb76-89f9-4042-9ab0-38331804abc8 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:38.218596 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44e057-afcb-424d-bab7-ff72a8789c83 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:38.218903 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44e057-afcb-424d-bab7-ff72a8789c83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.220366 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44e057-afcb-424d-bab7-ff72a8789c83 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-76d7bb76-89f9-4042-9ab0-38331804abc8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:38.229014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:38.230138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:38.231070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:38.231070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:38.231070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:38.231070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:38.231070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:38.231070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:38.231070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:38.231070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:38.231070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:01:38.231070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:38.231070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 283/561] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:38.231070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7bb76-89f9-4042-9ab0-38331804abc8 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:38.239780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 279/562] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Aug 18 21:01:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:38.240605 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44e057-afcb-424d-bab7-ff72a8789c83 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:38.257397 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:38.329829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7bb76-89f9-4042-9ab0-38331804abc8 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.337536 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44e057-afcb-424d-bab7-ff72a8789c83 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.361955 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f5501-0cd8-48f2-a023-61f438951fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.362585 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f5501-0cd8-48f2-a023-61f438951fff None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.362866 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f5501-0cd8-48f2-a023-61f438951fff None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.363696 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f5501-0cd8-48f2-a023-61f438951fff None admin] PATH_INFO: `/v3/projects/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.370154 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f5501-0cd8-48f2-a023-61f438951fff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.370647 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ee2d4-c16f-4a8e-9e07-460d0392445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.371272 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ee2d4-c16f-4a8e-9e07-460d0392445f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.371564 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ee2d4-c16f-4a8e-9e07-460d0392445f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.371664 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f5501-0cd8-48f2-a023-61f438951fff None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:38.371838 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ee2d4-c16f-4a8e-9e07-460d0392445f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.378577 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ee2d4-c16f-4a8e-9e07-460d0392445f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.380583 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ee2d4-c16f-4a8e-9e07-460d0392445f None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-812f5501-0cd8-48f2-a023-61f438951fff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:38.383112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:38.384169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:38.385031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:38.385031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:38.385031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:38.385031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:38.385031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:38.385031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:38.385031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:38.385031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:38.385031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 284/563] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:38.385031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f5501-0cd8-48f2-a023-61f438951fff None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-847ee2d4-c16f-4a8e-9e07-460d0392445f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:38.391784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:38.392840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:38.394041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:38.394041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:38.394041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:38.394041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:38.394041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:38.394041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:38.394041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:38.394041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:38.394041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 21:01:38.394041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:38.394041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 280/564] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:38.394041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ee2d4-c16f-4a8e-9e07-460d0392445f None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:38.408925 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:38.480059 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:38.496662 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f5501-0cd8-48f2-a023-61f438951fff None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.501008 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ee2d4-c16f-4a8e-9e07-460d0392445f None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.529908 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488fb1f-3ada-441b-b46e-d8ac0d7edc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.530495 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488fb1f-3ada-441b-b46e-d8ac0d7edc67 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.530772 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488fb1f-3ada-441b-b46e-d8ac0d7edc67 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.531038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488fb1f-3ada-441b-b46e-d8ac0d7edc67 None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.531784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488fb1f-3ada-441b-b46e-d8ac0d7edc67 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:38.532094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488fb1f-3ada-441b-b46e-d8ac0d7edc67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.533505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488fb1f-3ada-441b-b46e-d8ac0d7edc67 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:38.535519 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b2276-a1fc-41ce-aae1-fa629cef3b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.536138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b2276-a1fc-41ce-aae1-fa629cef3b3a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.536421 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b2276-a1fc-41ce-aae1-fa629cef3b3a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.536698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b2276-a1fc-41ce-aae1-fa629cef3b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.548094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b2276-a1fc-41ce-aae1-fa629cef3b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.549530 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b2276-a1fc-41ce-aae1-fa629cef3b3a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:38.554805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 285/565] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Aug 18 21:01:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:38.554805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488fb1f-3ada-441b-b46e-d8ac0d7edc67 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-1c7b2276-a1fc-41ce-aae1-fa629cef3b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:38.568450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:38.569587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:38.570676 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:38.570676 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:38.570676 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:38.570676 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 281/566] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:38.570676 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b2276-a1fc-41ce-aae1-fa629cef3b3a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:38.635496 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:38.654006 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488fb1f-3ada-441b-b46e-d8ac0d7edc67 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.677541 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b2276-a1fc-41ce-aae1-fa629cef3b3a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.688257 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f34a8-2052-4be3-b18f-0788eda9df78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.688856 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f34a8-2052-4be3-b18f-0788eda9df78 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.689128 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f34a8-2052-4be3-b18f-0788eda9df78 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.689390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f34a8-2052-4be3-b18f-0788eda9df78 None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.690068 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f34a8-2052-4be3-b18f-0788eda9df78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:38.690369 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f34a8-2052-4be3-b18f-0788eda9df78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.691882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f34a8-2052-4be3-b18f-0788eda9df78 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:38.703470 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 286/567] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:38.704248 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f34a8-2052-4be3-b18f-0788eda9df78 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:38.707178 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:38.711758 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5af4ee-5e0b-4425-87a2-4b12cb49faec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.712361 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5af4ee-5e0b-4425-87a2-4b12cb49faec None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.712641 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5af4ee-5e0b-4425-87a2-4b12cb49faec None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.712916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5af4ee-5e0b-4425-87a2-4b12cb49faec None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.713636 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5af4ee-5e0b-4425-87a2-4b12cb49faec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:38.713946 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5af4ee-5e0b-4425-87a2-4b12cb49faec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.715382 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5af4ee-5e0b-4425-87a2-4b12cb49faec None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:38.732766 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 282/568] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Aug 18 21:01:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:38.733503 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5af4ee-5e0b-4425-87a2-4b12cb49faec None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:38.810511 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f34a8-2052-4be3-b18f-0788eda9df78 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.838425 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5af4ee-5e0b-4425-87a2-4b12cb49faec None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.844096 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554de8d-efb9-4c42-86e8-3404a0d37b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.844720 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554de8d-efb9-4c42-86e8-3404a0d37b3a None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.845005 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554de8d-efb9-4c42-86e8-3404a0d37b3a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.845281 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554de8d-efb9-4c42-86e8-3404a0d37b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.856261 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554de8d-efb9-4c42-86e8-3404a0d37b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.857705 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554de8d-efb9-4c42-86e8-3404a0d37b3a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:38.858335 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-7554de8d-efb9-4c42-86e8-3404a0d37b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:38.871669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:38.872643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:38.873536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:38.873536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:38.873536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:38.873730 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3be9d-56c4-45b9-99a7-cd6e208217c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.873971 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 287/569] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:38.874051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3be9d-56c4-45b9-99a7-cd6e208217c8 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.874051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3be9d-56c4-45b9-99a7-cd6e208217c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.874051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3be9d-56c4-45b9-99a7-cd6e208217c8 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.874251 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554de8d-efb9-4c42-86e8-3404a0d37b3a None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:38.874327 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3be9d-56c4-45b9-99a7-cd6e208217c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:38.874327 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3be9d-56c4-45b9-99a7-cd6e208217c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.875703 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3be9d-56c4-45b9-99a7-cd6e208217c8 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:38.887807 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 283/570] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:38.888634 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3be9d-56c4-45b9-99a7-cd6e208217c8 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:38.934676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:38.980645 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554de8d-efb9-4c42-86e8-3404a0d37b3a None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.993197 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3be9d-56c4-45b9-99a7-cd6e208217c8 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:39.015309 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a4686-22e6-42b6-94be-7fa2c07db8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:39.015963 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a4686-22e6-42b6-94be-7fa2c07db8fe None admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:39.016247 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a4686-22e6-42b6-94be-7fa2c07db8fe None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:39.016524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a4686-22e6-42b6-94be-7fa2c07db8fe None admin] PATH_INFO: `/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/ba197525d2af40528f7cbe7de9da9a23/roles/c1a49401a509407295b9fff1cf635344` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:39.025732 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a5a62-f698-474e-9b08-9cf0b79af11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:39.026347 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a5a62-f698-474e-9b08-9cf0b79af11d None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:39.026626 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a5a62-f698-474e-9b08-9cf0b79af11d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:39.026894 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a5a62-f698-474e-9b08-9cf0b79af11d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:39.031906 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a4686-22e6-42b6-94be-7fa2c07db8fe None admin] RBAC: Authorizing `identity:create_grant(project_id=55812d15e0dc4e75bb9a31abfa3387bf, user_id=ba197525d2af40528f7cbe7de9da9a23, role_id=c1a49401a509407295b9fff1cf635344)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:39.033341 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a4686-22e6-42b6-94be-7fa2c07db8fe None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:39.037334 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a5a62-f698-474e-9b08-9cf0b79af11d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:39.038729 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a5a62-f698-474e-9b08-9cf0b79af11d None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:39.045608 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 288/571] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:01:38 2022] PUT /identity/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/ba197525d2af40528f7cbe7de9da9a23/roles/c1a49401a509407295b9fff1cf635344 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:39.046410 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a4686-22e6-42b6-94be-7fa2c07db8fe None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-2d0a5a62-f698-474e-9b08-9cf0b79af11d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:39.053481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:39.054706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:39.056303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:39.056303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:39.056303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:39.056303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 284/572] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:39.060409 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a5a62-f698-474e-9b08-9cf0b79af11d None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:39.098015 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:39.184771 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a5a62-f698-474e-9b08-9cf0b79af11d None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:39.185031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a4686-22e6-42b6-94be-7fa2c07db8fe None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:39.187710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:39.229196 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9dd0e-da23-42c7-a1b3-382055f37a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:39.229801 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9dd0e-da23-42c7-a1b3-382055f37a71 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:39.230078 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9dd0e-da23-42c7-a1b3-382055f37a71 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:39.230348 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9dd0e-da23-42c7-a1b3-382055f37a71 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:39.230992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9dd0e-da23-42c7-a1b3-382055f37a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:39.231967 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9dd0e-da23-42c7-a1b3-382055f37a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:39.233442 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9dd0e-da23-42c7-a1b3-382055f37a71 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:39.234811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117be8b-e6a1-430f-b5eb-d9ac21c3987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:39.235675 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117be8b-e6a1-430f-b5eb-d9ac21c3987a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:39.235961 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117be8b-e6a1-430f-b5eb-d9ac21c3987a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:39.236239 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117be8b-e6a1-430f-b5eb-d9ac21c3987a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:39.245162 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117be8b-e6a1-430f-b5eb-d9ac21c3987a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:39.246808 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117be8b-e6a1-430f-b5eb-d9ac21c3987a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:39.247218 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 289/573] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:39.248150 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9dd0e-da23-42c7-a1b3-382055f37a71 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-6117be8b-e6a1-430f-b5eb-d9ac21c3987a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:39.262406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:39.263418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:39.264312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:39.264312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:39.264312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:39.264312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:39.264312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:39.264312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:39.264312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:39.264312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:39.264312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 285/574] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:39.264805 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117be8b-e6a1-430f-b5eb-d9ac21c3987a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:39.357353 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9dd0e-da23-42c7-a1b3-382055f37a71 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:39.365719 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:39.376286 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117be8b-e6a1-430f-b5eb-d9ac21c3987a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:39.393534 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878de394-d4bf-4348-bb92-cb210afbaa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:39.394141 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878de394-d4bf-4348-bb92-cb210afbaa3c None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:39.394483 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878de394-d4bf-4348-bb92-cb210afbaa3c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:39.395072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878de394-d4bf-4348-bb92-cb210afbaa3c None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:39.395829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878de394-d4bf-4348-bb92-cb210afbaa3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:39.396138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878de394-d4bf-4348-bb92-cb210afbaa3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:39.397528 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878de394-d4bf-4348-bb92-cb210afbaa3c None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:39.413099 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add57bea-1731-408d-8b09-29711a04173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:39.413721 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add57bea-1731-408d-8b09-29711a04173b None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:39.414011 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add57bea-1731-408d-8b09-29711a04173b None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:39.414272 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add57bea-1731-408d-8b09-29711a04173b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:39.415002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 290/575] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:39.416079 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878de394-d4bf-4348-bb92-cb210afbaa3c None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:39.422755 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add57bea-1731-408d-8b09-29711a04173b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:39.424219 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add57bea-1731-408d-8b09-29711a04173b None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-add57bea-1731-408d-8b09-29711a04173b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:39.436891 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:39.437811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:39.438689 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:39.438689 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:39.438689 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:39.438689 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:39.438689 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:39.438689 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:39.438689 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:39.438689 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:39.443238 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 286/576] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:39.444101 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add57bea-1731-408d-8b09-29711a04173b None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:39.444234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:39.525083 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878de394-d4bf-4348-bb92-cb210afbaa3c None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:39.557832 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add57bea-1731-408d-8b09-29711a04173b None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:39.560056 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b1f2f-c02b-41b5-a97f-2db7031aae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:39.560964 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b1f2f-c02b-41b5-a97f-2db7031aae5b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:39.560964 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b1f2f-c02b-41b5-a97f-2db7031aae5b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:39.561216 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b1f2f-c02b-41b5-a97f-2db7031aae5b None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:39.561873 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b1f2f-c02b-41b5-a97f-2db7031aae5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:39.562179 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b1f2f-c02b-41b5-a97f-2db7031aae5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:39.563698 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b1f2f-c02b-41b5-a97f-2db7031aae5b None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:39.578308 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 291/577] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:39.578308 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b1f2f-c02b-41b5-a97f-2db7031aae5b None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:39.603720 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591398f-667b-4c2c-b33c-8a263d45438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:39.603914 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591398f-667b-4c2c-b33c-8a263d45438b None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:39.604196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591398f-667b-4c2c-b33c-8a263d45438b None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:39.604475 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591398f-667b-4c2c-b33c-8a263d45438b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:39.612340 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591398f-667b-4c2c-b33c-8a263d45438b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:39.614413 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591398f-667b-4c2c-b33c-8a263d45438b None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-e591398f-667b-4c2c-b33c-8a263d45438b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:39.625644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:39.626702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:39.628332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:39.628332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:39.628332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:39.628332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:39.628332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:39.628332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:39.628332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:39.628332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:39.628332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 287/578] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:39.628332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591398f-667b-4c2c-b33c-8a263d45438b None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:39.643598 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:39.678023 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:39.696418 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b1f2f-c02b-41b5-a97f-2db7031aae5b None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:39.734697 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591398f-667b-4c2c-b33c-8a263d45438b None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:39.739284 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2ec1e-78f9-48db-b904-21e12522d7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:39.739967 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2ec1e-78f9-48db-b904-21e12522d7fa None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:39.740319 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2ec1e-78f9-48db-b904-21e12522d7fa None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:39.740666 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2ec1e-78f9-48db-b904-21e12522d7fa None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:39.741432 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2ec1e-78f9-48db-b904-21e12522d7fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:39.741812 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2ec1e-78f9-48db-b904-21e12522d7fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:39.743901 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2ec1e-78f9-48db-b904-21e12522d7fa None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:39.765232 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 292/579] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:39.765232 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2ec1e-78f9-48db-b904-21e12522d7fa None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:39.770089 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c294ed5-1d79-409b-8460-1fc797bf4117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:39.770860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c294ed5-1d79-409b-8460-1fc797bf4117 None admin] REQUEST_METHOD: `PUT` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:39.771235 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c294ed5-1d79-409b-8460-1fc797bf4117 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:39.771626 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c294ed5-1d79-409b-8460-1fc797bf4117 None admin] PATH_INFO: `/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/255b174cea9f41f6970978c44bec2b8f/roles/c1a49401a509407295b9fff1cf635344` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:39.787625 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c294ed5-1d79-409b-8460-1fc797bf4117 None admin] RBAC: Authorizing `identity:create_grant(project_id=55812d15e0dc4e75bb9a31abfa3387bf, user_id=255b174cea9f41f6970978c44bec2b8f, role_id=c1a49401a509407295b9fff1cf635344)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:39.789344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c294ed5-1d79-409b-8460-1fc797bf4117 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:39.801697 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 288/580] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:01:39 2022] PUT /identity/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/255b174cea9f41f6970978c44bec2b8f/roles/c1a49401a509407295b9fff1cf635344 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:39.802727 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c294ed5-1d79-409b-8460-1fc797bf4117 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:39.893904 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:39.899431 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2ec1e-78f9-48db-b904-21e12522d7fa None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:39.937824 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268a4ee-532c-47f4-a979-d304e80e871e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:39.938759 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268a4ee-532c-47f4-a979-d304e80e871e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:39.939187 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268a4ee-532c-47f4-a979-d304e80e871e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:39.939654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268a4ee-532c-47f4-a979-d304e80e871e None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:39.940630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268a4ee-532c-47f4-a979-d304e80e871e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:39.941667 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268a4ee-532c-47f4-a979-d304e80e871e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:39.943365 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268a4ee-532c-47f4-a979-d304e80e871e None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:39.949803 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c294ed5-1d79-409b-8460-1fc797bf4117 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:39.958171 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 293/581] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:39.967029 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268a4ee-532c-47f4-a979-d304e80e871e None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:39.968354 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:39.995736 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d120ef5-58e3-495b-ae6e-808bec14772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:39.996782 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120ef5-58e3-495b-ae6e-808bec14772e None admin] REQUEST_METHOD: `PUT` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:39.997061 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120ef5-58e3-495b-ae6e-808bec14772e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:39.998706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120ef5-58e3-495b-ae6e-808bec14772e None admin] PATH_INFO: `/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/3510dd48a215455fb55bfbec820c7f3c/roles/c1a49401a509407295b9fff1cf635344` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:40.017751 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d120ef5-58e3-495b-ae6e-808bec14772e None admin] RBAC: Authorizing `identity:create_grant(project_id=55812d15e0dc4e75bb9a31abfa3387bf, user_id=3510dd48a215455fb55bfbec820c7f3c, role_id=c1a49401a509407295b9fff1cf635344)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:40.019239 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d120ef5-58e3-495b-ae6e-808bec14772e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:40.033531 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 289/582] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:01:39 2022] PUT /identity/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/3510dd48a215455fb55bfbec820c7f3c/roles/c1a49401a509407295b9fff1cf635344 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:40.094261 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268a4ee-532c-47f4-a979-d304e80e871e None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:40.136376 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fea27-cc3d-4161-86a9-c72eb6da45af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:40.137203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fea27-cc3d-4161-86a9-c72eb6da45af None admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:40.137546 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fea27-cc3d-4161-86a9-c72eb6da45af None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:40.137887 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fea27-cc3d-4161-86a9-c72eb6da45af None admin] PATH_INFO: `/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/b9326ebc83a2471a856f668ee77285c5/roles/c1a49401a509407295b9fff1cf635344` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:40.157784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fea27-cc3d-4161-86a9-c72eb6da45af None admin] RBAC: Authorizing `identity:create_grant(project_id=55812d15e0dc4e75bb9a31abfa3387bf, user_id=b9326ebc83a2471a856f668ee77285c5, role_id=c1a49401a509407295b9fff1cf635344)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:40.159462 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fea27-cc3d-4161-86a9-c72eb6da45af None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:40.178672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 294/583] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:01:39 2022] PUT /identity/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/b9326ebc83a2471a856f668ee77285c5/roles/c1a49401a509407295b9fff1cf635344 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:41.284636 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade25062-da81-467c-859f-fff9b6c03fb7 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:41.285216 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade25062-da81-467c-859f-fff9b6c03fb7 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:41.285216 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade25062-da81-467c-859f-fff9b6c03fb7 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:41.286535 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 290/584] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:41.291834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb4179-ffa6-4910-a6c4-9dba1c393dda None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:41.292231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb4179-ffa6-4910-a6c4-9dba1c393dda None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:41.292412 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb4179-ffa6-4910-a6c4-9dba1c393dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:41.311067 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-65eb4179-ffa6-4910-a6c4-9dba1c393dda None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:41.312291 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-65eb4179-ffa6-4910-a6c4-9dba1c393dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:41.371608 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:41.388159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 295/585] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:41.714722 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade25062-da81-467c-859f-fff9b6c03fb7 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:41.824869 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade25062-da81-467c-859f-fff9b6c03fb7 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:41.839436 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:41.861086 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8a17e-a1bb-483b-9cba-929c680a1415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:41.861644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8a17e-a1bb-483b-9cba-929c680a1415 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:41.861931 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8a17e-a1bb-483b-9cba-929c680a1415 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:41.862208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8a17e-a1bb-483b-9cba-929c680a1415 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:41.874048 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8a17e-a1bb-483b-9cba-929c680a1415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-d9d8a17e-a1bb-483b-9cba-929c680a1415 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:41.879695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:41.880630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:41.881471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:41.881471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:41.881471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:41.881471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:41.881471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:41.881471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:41.881471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:41.881471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:41.881471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:41.881471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:41.881471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:41.881471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:41.884758 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 291/586] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:41.890686 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb4179-ffa6-4910-a6c4-9dba1c393dda None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:42.002487 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb4179-ffa6-4910-a6c4-9dba1c393dda None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:42.041224 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5850d-b7f7-4c8b-bc82-8f7c31c88797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:42.042243 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5850d-b7f7-4c8b-bc82-8f7c31c88797 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.042753 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5850d-b7f7-4c8b-bc82-8f7c31c88797 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.043216 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5850d-b7f7-4c8b-bc82-8f7c31c88797 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.044087 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5850d-b7f7-4c8b-bc82-8f7c31c88797 None admin] RBAC: Adding query filter params (name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:42.044601 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5850d-b7f7-4c8b-bc82-8f7c31c88797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:42.046154 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5850d-b7f7-4c8b-bc82-8f7c31c88797 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:42.055445 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 296/587] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:01:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:42.061318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8a17e-a1bb-483b-9cba-929c680a1415 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:42.151811 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07376c0c-7c13-4300-9965-ca8aa6720abe None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.152413 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07376c0c-7c13-4300-9965-ca8aa6720abe None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.152957 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07376c0c-7c13-4300-9965-ca8aa6720abe None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.154745 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 297/588] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:42.161065 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee12f9-bfba-4ed7-b441-3a764e80fd2f None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.161592 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee12f9-bfba-4ed7-b441-3a764e80fd2f None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.162058 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee12f9-bfba-4ed7-b441-3a764e80fd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.168808 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8a17e-a1bb-483b-9cba-929c680a1415 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:42.182018 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-41ee12f9-bfba-4ed7-b441-3a764e80fd2f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:42.183708 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-41ee12f9-bfba-4ed7-b441-3a764e80fd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:42.203752 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c3fdb-c446-4195-9efd-82558117444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:42.204391 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c3fdb-c446-4195-9efd-82558117444f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.204668 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c3fdb-c446-4195-9efd-82558117444f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.204936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c3fdb-c446-4195-9efd-82558117444f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.219208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c3fdb-c446-4195-9efd-82558117444f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:42.221719 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c3fdb-c446-4195-9efd-82558117444f None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:42.236646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-7e9c3fdb-c446-4195-9efd-82558117444f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:42.243772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:42.244813 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:42.245692 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:42.245692 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:42.245692 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:42.245692 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 292/589] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:42.252061 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c3fdb-c446-4195-9efd-82558117444f None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:42.279954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:42.280294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 298/590] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:42.359989 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c3fdb-c446-4195-9efd-82558117444f None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:42.393558 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ee40f-d6da-406a-b304-f2f68e1ecdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:42.394214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ee40f-d6da-406a-b304-f2f68e1ecdd8 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.394492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ee40f-d6da-406a-b304-f2f68e1ecdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.394763 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ee40f-d6da-406a-b304-f2f68e1ecdd8 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.395486 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ee40f-d6da-406a-b304-f2f68e1ecdd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:42.395790 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ee40f-d6da-406a-b304-f2f68e1ecdd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:42.397149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ee40f-d6da-406a-b304-f2f68e1ecdd8 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:42.410226 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 293/591] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:42.415583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee12f9-bfba-4ed7-b441-3a764e80fd2f None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:42.419660 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286bfe1-a292-4ce5-b08d-ffa85b4d1e14 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.419947 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286bfe1-a292-4ce5-b08d-ffa85b4d1e14 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.420218 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286bfe1-a292-4ce5-b08d-ffa85b4d1e14 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.421740 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 294/592] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:01:42.427148 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d55a-fec6-4618-9317-61d18841c603 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.427462 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d55a-fec6-4618-9317-61d18841c603 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.427740 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d55a-fec6-4618-9317-61d18841c603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.446152 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-eab6d55a-fec6-4618-9317-61d18841c603 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:42.447731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-eab6d55a-fec6-4618-9317-61d18841c603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:42.518868 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 295/593] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:42.520904 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea0c70-e73a-43d4-9b6a-c567fb9c6aca None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.521393 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea0c70-e73a-43d4-9b6a-c567fb9c6aca None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.521885 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea0c70-e73a-43d4-9b6a-c567fb9c6aca None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.524087 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 296/594] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:42.529167 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169c43-5291-4392-8698-43cc68a6be9d None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.529627 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169c43-5291-4392-8698-43cc68a6be9d None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.529911 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169c43-5291-4392-8698-43cc68a6be9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.535309 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee12f9-bfba-4ed7-b441-3a764e80fd2f None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:42.548949 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-9f169c43-5291-4392-8698-43cc68a6be9d None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:42.550264 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-9f169c43-5291-4392-8698-43cc68a6be9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:42.561559 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:42.582507 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cfceb-ff46-430b-a1dd-fba95da31b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:42.583651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cfceb-ff46-430b-a1dd-fba95da31b6d None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.584223 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cfceb-ff46-430b-a1dd-fba95da31b6d None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.584912 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cfceb-ff46-430b-a1dd-fba95da31b6d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.594108 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cfceb-ff46-430b-a1dd-fba95da31b6d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:42.595765 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cfceb-ff46-430b-a1dd-fba95da31b6d None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-b51cfceb-ff46-430b-a1dd-fba95da31b6d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:42.611922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:42.613576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:42.614741 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:42.614741 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:42.614741 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:42.614741 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:42.614741 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:42.614741 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:42.614741 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:42.614741 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:42.614741 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:01:42.614741 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:42.621121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 299/595] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Aug 18 21:01:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:42.624387 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cfceb-ff46-430b-a1dd-fba95da31b6d None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:42.643737 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 297/596] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:42.644625 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f169c43-5291-4392-8698-43cc68a6be9d None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:42.674933 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:42.751418 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cfceb-ff46-430b-a1dd-fba95da31b6d None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:42.770528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f169c43-5291-4392-8698-43cc68a6be9d None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:42.791737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934b935-12d9-47ed-bdf4-40c33196a7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:42.792886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934b935-12d9-47ed-bdf4-40c33196a7dd None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.793327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934b935-12d9-47ed-bdf4-40c33196a7dd None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.793749 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934b935-12d9-47ed-bdf4-40c33196a7dd None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.794607 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934b935-12d9-47ed-bdf4-40c33196a7dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:42.795079 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934b935-12d9-47ed-bdf4-40c33196a7dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:42.797479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934b935-12d9-47ed-bdf4-40c33196a7dd None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:42.811197 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa0655-5bbe-414c-8cb8-ded5a5bc4508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:42.811856 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa0655-5bbe-414c-8cb8-ded5a5bc4508 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.812238 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa0655-5bbe-414c-8cb8-ded5a5bc4508 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.812705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa0655-5bbe-414c-8cb8-ded5a5bc4508 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.825988 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 300/597] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Aug 18 21:01:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:42.827230 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934b935-12d9-47ed-bdf4-40c33196a7dd None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:42.827801 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa0655-5bbe-414c-8cb8-ded5a5bc4508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-b6aa0655-5bbe-414c-8cb8-ded5a5bc4508 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:42.833079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:42.834003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:42.834862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:42.834862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:42.834862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:42.834862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:42.834862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:42.834862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:42.834862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:42.834862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:42.834862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:42.834862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:42.834862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:42.834862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:42.834862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 298/598] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:42.843069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa0655-5bbe-414c-8cb8-ded5a5bc4508 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:42.848747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:42.946556 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:42.950240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa0655-5bbe-414c-8cb8-ded5a5bc4508 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:42.957384 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934b935-12d9-47ed-bdf4-40c33196a7dd None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:42.990086 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5ba3d-43be-4693-bd18-59ed4d2670bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:42.990687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5ba3d-43be-4693-bd18-59ed4d2670bd None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.990968 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5ba3d-43be-4693-bd18-59ed4d2670bd None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.991247 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5ba3d-43be-4693-bd18-59ed4d2670bd None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.991925 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764d9e8-fa0d-4440-970f-e6c29671d1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:42.992046 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5ba3d-43be-4693-bd18-59ed4d2670bd None admin] RBAC: Adding query filter params (name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:42.992234 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5ba3d-43be-4693-bd18-59ed4d2670bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:42.992519 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764d9e8-fa0d-4440-970f-e6c29671d1d6 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:42.992793 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764d9e8-fa0d-4440-970f-e6c29671d1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:42.993061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764d9e8-fa0d-4440-970f-e6c29671d1d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:42.993604 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5ba3d-43be-4693-bd18-59ed4d2670bd None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:43.001826 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 299/599] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:01:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:43.002620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5ba3d-43be-4693-bd18-59ed4d2670bd None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:43.060459 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764d9e8-fa0d-4440-970f-e6c29671d1d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:43.061913 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764d9e8-fa0d-4440-970f-e6c29671d1d6 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:43.068317 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:43.105103 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5ba3d-43be-4693-bd18-59ed4d2670bd None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:43.138977 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc95674-0db4-4bd4-a407-b40fabbb59b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:43.139623 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc95674-0db4-4bd4-a407-b40fabbb59b3 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:43.139897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc95674-0db4-4bd4-a407-b40fabbb59b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:43.140163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc95674-0db4-4bd4-a407-b40fabbb59b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:43.149980 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc95674-0db4-4bd4-a407-b40fabbb59b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:43.153764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-6fc95674-0db4-4bd4-a407-b40fabbb59b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:43.154963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:43.156028 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:43.156963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:43.156963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:43.156963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:43.156963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:43.156963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:43.156963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:43.156963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:43.156963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:43.156963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:43.156963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:43.156963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:43.156963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:43.156963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 300/600] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:43.157778 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc95674-0db4-4bd4-a407-b40fabbb59b3 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:43.165742 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 301/601] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:43.166689 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764d9e8-fa0d-4440-970f-e6c29671d1d6 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:43.260322 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc95674-0db4-4bd4-a407-b40fabbb59b3 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:43.265464 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764d9e8-fa0d-4440-970f-e6c29671d1d6 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:43.286429 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:43.294820 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e506c1-849d-460b-9bb7-cc18d5ff419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:43.295469 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e506c1-849d-460b-9bb7-cc18d5ff419f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:43.295752 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e506c1-849d-460b-9bb7-cc18d5ff419f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:43.296027 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e506c1-849d-460b-9bb7-cc18d5ff419f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:43.298917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d10e30-8250-4f88-962d-ccab8347c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:43.299572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d10e30-8250-4f88-962d-ccab8347c59f None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:43.299854 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d10e30-8250-4f88-962d-ccab8347c59f None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:43.300126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d10e30-8250-4f88-962d-ccab8347c59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:43.305887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e506c1-849d-460b-9bb7-cc18d5ff419f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:43.310066 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d10e30-8250-4f88-962d-ccab8347c59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-71e506c1-849d-460b-9bb7-cc18d5ff419f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:43.310945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:43.312069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:43.312962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:43.312962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:43.312962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:43.312962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:43.312962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:43.312962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:43.312962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:43.312962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:43.312962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:43.312962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:43.312962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:01:43.312962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:43.313677 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d10e30-8250-4f88-962d-ccab8347c59f None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:43.313760 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 301/602] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:43.313760 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e506c1-849d-460b-9bb7-cc18d5ff419f None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-83d10e30-8250-4f88-962d-ccab8347c59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:43.329000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:43.330123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:43.331222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:43.331222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:43.331222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:43.331222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 302/603] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:43.331222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d10e30-8250-4f88-962d-ccab8347c59f None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:43.376880 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:43.416785 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e506c1-849d-460b-9bb7-cc18d5ff419f None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:43.430071 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d10e30-8250-4f88-962d-ccab8347c59f None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:43.450897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d87f6-01ad-4ba2-8ec7-f6039789ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:43.451525 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d87f6-01ad-4ba2-8ec7-f6039789ab62 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:43.451810 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d87f6-01ad-4ba2-8ec7-f6039789ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:43.452088 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d87f6-01ad-4ba2-8ec7-f6039789ab62 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:43.452772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d87f6-01ad-4ba2-8ec7-f6039789ab62 None admin] RBAC: Adding query filter params (name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:43.453082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d87f6-01ad-4ba2-8ec7-f6039789ab62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:43.454448 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d87f6-01ad-4ba2-8ec7-f6039789ab62 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:43.462232 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 302/604] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:01:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:43.463018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d87f6-01ad-4ba2-8ec7-f6039789ab62 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:43.463120 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026afb91-44ee-4fa2-b742-d4b5412480f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:43.463683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026afb91-44ee-4fa2-b742-d4b5412480f2 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:43.463962 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026afb91-44ee-4fa2-b742-d4b5412480f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:43.464233 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026afb91-44ee-4fa2-b742-d4b5412480f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:43.475184 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026afb91-44ee-4fa2-b742-d4b5412480f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:43.476671 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026afb91-44ee-4fa2-b742-d4b5412480f2 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-026afb91-44ee-4fa2-b742-d4b5412480f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:43.490850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:43.491994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:43.492898 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:43.492898 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:43.492898 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:43.492898 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 303/605] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:43.492898 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026afb91-44ee-4fa2-b742-d4b5412480f2 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:43.519372 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:43.571818 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d87f6-01ad-4ba2-8ec7-f6039789ab62 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:43.588971 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:43.593381 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026afb91-44ee-4fa2-b742-d4b5412480f2 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:43.604502 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9a12f-bc64-4bcd-8203-bb42bfed7608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:43.605139 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9a12f-bc64-4bcd-8203-bb42bfed7608 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:43.605429 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9a12f-bc64-4bcd-8203-bb42bfed7608 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:43.605701 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9a12f-bc64-4bcd-8203-bb42bfed7608 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:43.606359 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9a12f-bc64-4bcd-8203-bb42bfed7608 None admin] RBAC: Adding query filter params (name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:43.606669 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9a12f-bc64-4bcd-8203-bb42bfed7608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:43.608109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9a12f-bc64-4bcd-8203-bb42bfed7608 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:43.616562 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 303/606] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:01:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:43.617406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9a12f-bc64-4bcd-8203-bb42bfed7608 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:43.629501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de00551-714d-4078-a3fd-9384b8c8d908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:43.630095 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de00551-714d-4078-a3fd-9384b8c8d908 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:43.630373 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de00551-714d-4078-a3fd-9384b8c8d908 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:43.630642 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de00551-714d-4078-a3fd-9384b8c8d908 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:43.631302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de00551-714d-4078-a3fd-9384b8c8d908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:43.631607 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de00551-714d-4078-a3fd-9384b8c8d908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:43.632973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de00551-714d-4078-a3fd-9384b8c8d908 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:43.644423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 304/607] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:43.645205 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de00551-714d-4078-a3fd-9384b8c8d908 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:43.715363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9a12f-bc64-4bcd-8203-bb42bfed7608 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:43.726193 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:43.746396 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de00551-714d-4078-a3fd-9384b8c8d908 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:43.749407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f5f06-1e17-4de2-8056-0e80bce002b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:43.750023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f5f06-1e17-4de2-8056-0e80bce002b3 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:43.750298 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f5f06-1e17-4de2-8056-0e80bce002b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:43.750567 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f5f06-1e17-4de2-8056-0e80bce002b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:43.761285 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f5f06-1e17-4de2-8056-0e80bce002b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:43.762744 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f5f06-1e17-4de2-8056-0e80bce002b3 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-314f5f06-1e17-4de2-8056-0e80bce002b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:43.777052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:43.778126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:43.779016 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:43.779016 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:43.779016 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:43.779016 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 304/608] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:43.779016 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f5f06-1e17-4de2-8056-0e80bce002b3 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:43.781787 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94309ab6-8bef-417d-abad-b070d4f39a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:43.782472 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94309ab6-8bef-417d-abad-b070d4f39a23 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:43.782760 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94309ab6-8bef-417d-abad-b070d4f39a23 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:43.783037 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94309ab6-8bef-417d-abad-b070d4f39a23 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:43.783708 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94309ab6-8bef-417d-abad-b070d4f39a23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:43.784015 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94309ab6-8bef-417d-abad-b070d4f39a23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:43.785457 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94309ab6-8bef-417d-abad-b070d4f39a23 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:43.796698 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 305/609] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:43.797497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94309ab6-8bef-417d-abad-b070d4f39a23 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:43.817504 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:43.878835 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f5f06-1e17-4de2-8056-0e80bce002b3 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:43.898000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94309ab6-8bef-417d-abad-b070d4f39a23 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:43.912215 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4add5fe-e1ca-4381-bc0b-0a82fa5be0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:43.912835 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4add5fe-e1ca-4381-bc0b-0a82fa5be0de None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:43.913124 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4add5fe-e1ca-4381-bc0b-0a82fa5be0de None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:43.913401 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4add5fe-e1ca-4381-bc0b-0a82fa5be0de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:43.923711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4add5fe-e1ca-4381-bc0b-0a82fa5be0de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:43.925191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4add5fe-e1ca-4381-bc0b-0a82fa5be0de None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:43.930660 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9219c-ca9b-4cab-8ba8-fd095525e14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:43.931705 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9219c-ca9b-4cab-8ba8-fd095525e14e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:43.931997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9219c-ca9b-4cab-8ba8-fd095525e14e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:43.932295 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9219c-ca9b-4cab-8ba8-fd095525e14e None admin] PATH_INFO: `/v3/users/glance` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-f4add5fe-e1ca-4381-bc0b-0a82fa5be0de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:43.938845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:43.939916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:43.941279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:43.941279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:43.941279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:43.941462 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9219c-ca9b-4cab-8ba8-fd095525e14e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:43.941534 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 305/610] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:43.941534 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4add5fe-e1ca-4381-bc0b-0a82fa5be0de None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:43.941711 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9219c-ca9b-4cab-8ba8-fd095525e14e None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-e6f9219c-ca9b-4cab-8ba8-fd095525e14e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:43.954969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:43.956094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:43.957644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:43.957644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:43.957644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:43.957644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:43.957644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:43.957644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:43.957644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:43.957644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:43.957644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 21:01:43.957644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:43.957644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 306/611] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:43.957644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9219c-ca9b-4cab-8ba8-fd095525e14e None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:43.962064 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:44.039351 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:44.045420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4add5fe-e1ca-4381-bc0b-0a82fa5be0de None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:44.061297 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9219c-ca9b-4cab-8ba8-fd095525e14e None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:44.078497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72740c2-212f-4e24-82a4-0dd6bc23ebea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:44.079089 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72740c2-212f-4e24-82a4-0dd6bc23ebea None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:44.079393 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72740c2-212f-4e24-82a4-0dd6bc23ebea None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:44.079664 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72740c2-212f-4e24-82a4-0dd6bc23ebea None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:44.080292 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72740c2-212f-4e24-82a4-0dd6bc23ebea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:44.080599 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72740c2-212f-4e24-82a4-0dd6bc23ebea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:44.082453 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72740c2-212f-4e24-82a4-0dd6bc23ebea None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:44.094307 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 306/612] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:44.094429 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4267e1-69d0-4917-9495-63539cc0864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:44.094953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4267e1-69d0-4917-9495-63539cc0864b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:44.095235 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4267e1-69d0-4917-9495-63539cc0864b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:44.095427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72740c2-212f-4e24-82a4-0dd6bc23ebea None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:44.095550 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4267e1-69d0-4917-9495-63539cc0864b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:44.104377 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4267e1-69d0-4917-9495-63539cc0864b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:44.105825 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4267e1-69d0-4917-9495-63539cc0864b None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-ad4267e1-69d0-4917-9495-63539cc0864b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:44.117294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:44.118362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:44.119623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:44.119623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:44.119623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:44.119623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:44.119623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:44.119623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:44.119623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:44.119623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:44.119623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 307/613] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:44.119623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4267e1-69d0-4917-9495-63539cc0864b None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:44.174331 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:44.200190 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72740c2-212f-4e24-82a4-0dd6bc23ebea None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:44.222708 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4267e1-69d0-4917-9495-63539cc0864b None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:44.233719 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175acf-fdf0-4cce-acad-28b590ec285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:44.234343 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175acf-fdf0-4cce-acad-28b590ec285f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:44.234594 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175acf-fdf0-4cce-acad-28b590ec285f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:44.234861 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175acf-fdf0-4cce-acad-28b590ec285f None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:44.235510 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e175acf-fdf0-4cce-acad-28b590ec285f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:44.235888 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e175acf-fdf0-4cce-acad-28b590ec285f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:44.237205 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e175acf-fdf0-4cce-acad-28b590ec285f None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:44.248474 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 307/614] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:44.249283 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175acf-fdf0-4cce-acad-28b590ec285f None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:44.256533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c466e-f09f-4a55-9656-db51c2f79dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:44.257135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c466e-f09f-4a55-9656-db51c2f79dbe None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:44.257416 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c466e-f09f-4a55-9656-db51c2f79dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:44.257688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c466e-f09f-4a55-9656-db51c2f79dbe None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:44.258409 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c466e-f09f-4a55-9656-db51c2f79dbe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:44.258715 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c466e-f09f-4a55-9656-db51c2f79dbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:44.260161 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c466e-f09f-4a55-9656-db51c2f79dbe None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:44.268301 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:44.278233 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 308/615] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Aug 18 21:01:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:44.278915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c466e-f09f-4a55-9656-db51c2f79dbe None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:44.348395 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175acf-fdf0-4cce-acad-28b590ec285f None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:44.376805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c466e-f09f-4a55-9656-db51c2f79dbe None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:44.382199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8761c-49df-40f2-a81c-5e26dcf11230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:44.382812 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8761c-49df-40f2-a81c-5e26dcf11230 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:44.383087 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8761c-49df-40f2-a81c-5e26dcf11230 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:44.383390 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8761c-49df-40f2-a81c-5e26dcf11230 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:44.385355 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:44.391923 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8761c-49df-40f2-a81c-5e26dcf11230 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:44.393342 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8761c-49df-40f2-a81c-5e26dcf11230 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-63e8761c-49df-40f2-a81c-5e26dcf11230 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:44.404041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:44.405045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:44.405965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:44.405965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:44.405965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:44.405965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:44.405965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:44.405965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:44.405965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:44.405965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:44.405965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:01:44.405965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:44.405965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 308/616] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:44.405965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8761c-49df-40f2-a81c-5e26dcf11230 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:44.413827 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256ecb2-cc50-41a9-bdf2-16c9bd441ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:44.414420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256ecb2-cc50-41a9-bdf2-16c9bd441ba0 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:44.414695 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256ecb2-cc50-41a9-bdf2-16c9bd441ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:44.414961 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256ecb2-cc50-41a9-bdf2-16c9bd441ba0 None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:44.415665 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256ecb2-cc50-41a9-bdf2-16c9bd441ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:44.415967 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256ecb2-cc50-41a9-bdf2-16c9bd441ba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:44.417502 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256ecb2-cc50-41a9-bdf2-16c9bd441ba0 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:44.429395 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 309/617] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:44.430175 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256ecb2-cc50-41a9-bdf2-16c9bd441ba0 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:44.486207 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:44.515773 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8761c-49df-40f2-a81c-5e26dcf11230 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:44.531981 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256ecb2-cc50-41a9-bdf2-16c9bd441ba0 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:44.549226 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d0536-6d21-491f-a1f7-36896dcb74fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:44.549837 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d0536-6d21-491f-a1f7-36896dcb74fa None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:44.550707 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d0536-6d21-491f-a1f7-36896dcb74fa None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:44.550987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d0536-6d21-491f-a1f7-36896dcb74fa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:44.558105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d0536-6d21-491f-a1f7-36896dcb74fa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:44.559555 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d0536-6d21-491f-a1f7-36896dcb74fa None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:44.565424 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8edf7-6dfa-4225-8cdb-7a2d34e60c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:44.566046 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8edf7-6dfa-4225-8cdb-7a2d34e60c3b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:44.566325 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8edf7-6dfa-4225-8cdb-7a2d34e60c3b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:44.566595 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8edf7-6dfa-4225-8cdb-7a2d34e60c3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-173d0536-6d21-491f-a1f7-36896dcb74fa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:44.570276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:44.571371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:44.572606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:44.572606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:44.572606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:44.572606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:44.572606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:44.572606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:44.572606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:44.572606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:44.572606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 21:01:44.572606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:44.572606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 309/618] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:01:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:44.572606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d0536-6d21-491f-a1f7-36896dcb74fa None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:44.630777 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:44.637082 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8edf7-6dfa-4225-8cdb-7a2d34e60c3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:44.638551 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8edf7-6dfa-4225-8cdb-7a2d34e60c3b None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:44.677376 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d0536-6d21-491f-a1f7-36896dcb74fa None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:44.692282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:44.710851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84da6b-3983-400e-960c-7371bf460984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:44.711472 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84da6b-3983-400e-960c-7371bf460984 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:44.711750 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84da6b-3983-400e-960c-7371bf460984 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:44.712019 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84da6b-3983-400e-960c-7371bf460984 None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:44.712837 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84da6b-3983-400e-960c-7371bf460984 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:44.713149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84da6b-3983-400e-960c-7371bf460984 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:44.714558 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84da6b-3983-400e-960c-7371bf460984 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:44.731282 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 310/619] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Aug 18 21:01:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:44.732122 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84da6b-3983-400e-960c-7371bf460984 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:44.742368 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 310/620] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:44.742368 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8edf7-6dfa-4225-8cdb-7a2d34e60c3b None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:44.830416 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84da6b-3983-400e-960c-7371bf460984 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:44.837558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8edf7-6dfa-4225-8cdb-7a2d34e60c3b None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:44.843592 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:44.866167 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493be699-de7b-4be1-a1de-17ba322265cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:44.866695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493be699-de7b-4be1-a1de-17ba322265cc None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:44.866968 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493be699-de7b-4be1-a1de-17ba322265cc None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:44.867237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493be699-de7b-4be1-a1de-17ba322265cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:44.867971 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493be699-de7b-4be1-a1de-17ba322265cc None admin] RBAC: Adding query filter params (role.id=c1a49401a509407295b9fff1cf635344, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=ba197525d2af40528f7cbe7de9da9a23) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:44.868274 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493be699-de7b-4be1-a1de-17ba322265cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:44.869693 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493be699-de7b-4be1-a1de-17ba322265cc None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:44.871160 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8be0c-6e5c-4d0d-af05-e9dbab42021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:44.871788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8be0c-6e5c-4d0d-af05-e9dbab42021c None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:44.872060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8be0c-6e5c-4d0d-af05-e9dbab42021c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:44.872701 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8be0c-6e5c-4d0d-af05-e9dbab42021c None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:44.873038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8be0c-6e5c-4d0d-af05-e9dbab42021c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:44.873342 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8be0c-6e5c-4d0d-af05-e9dbab42021c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:44.874744 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8be0c-6e5c-4d0d-af05-e9dbab42021c None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:44.875422 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 311/621] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:01:44 2022] GET /identity/v3/role_assignments?user.id=ba197525d2af40528f7cbe7de9da9a23&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=c1a49401a509407295b9fff1cf635344 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:44.876193 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493be699-de7b-4be1-a1de-17ba322265cc None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:44.900826 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 311/622] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Aug 18 21:01:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:44.904880 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8be0c-6e5c-4d0d-af05-e9dbab42021c None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:44.923018 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:44.989726 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493be699-de7b-4be1-a1de-17ba322265cc None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:45.023280 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8be0c-6e5c-4d0d-af05-e9dbab42021c None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:45.027217 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dee946-101d-4dd4-bba4-bd29cf36788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:45.027864 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dee946-101d-4dd4-bba4-bd29cf36788d None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:45.028154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dee946-101d-4dd4-bba4-bd29cf36788d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:45.028412 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dee946-101d-4dd4-bba4-bd29cf36788d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:45.065487 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785430ef-54b2-4439-a6e6-b60db096192e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:45.066534 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785430ef-54b2-4439-a6e6-b60db096192e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:45.066964 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785430ef-54b2-4439-a6e6-b60db096192e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:45.067336 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785430ef-54b2-4439-a6e6-b60db096192e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:45.078725 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785430ef-54b2-4439-a6e6-b60db096192e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:45.080256 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785430ef-54b2-4439-a6e6-b60db096192e None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:45.082424 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-785430ef-54b2-4439-a6e6-b60db096192e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:45.096895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:45.098390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:45.099731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:45.099731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:45.099731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:45.099731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 312/623] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:45.100304 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785430ef-54b2-4439-a6e6-b60db096192e None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:45.111482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dee946-101d-4dd4-bba4-bd29cf36788d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:45.113558 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dee946-101d-4dd4-bba4-bd29cf36788d None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:45.174963 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:45.214152 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785430ef-54b2-4439-a6e6-b60db096192e None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:45.220052 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 312/624] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:45.224180 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dee946-101d-4dd4-bba4-bd29cf36788d None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:45.250917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc3a91-1bed-4ecc-8d68-1fa168663d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:45.251726 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc3a91-1bed-4ecc-8d68-1fa168663d5b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:45.252106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc3a91-1bed-4ecc-8d68-1fa168663d5b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:45.252384 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc3a91-1bed-4ecc-8d68-1fa168663d5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:45.306167 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:45.327549 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc3a91-1bed-4ecc-8d68-1fa168663d5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:45.329009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc3a91-1bed-4ecc-8d68-1fa168663d5b None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:45.332861 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dee946-101d-4dd4-bba4-bd29cf36788d None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:45.368246 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933742-7283-40bc-87f8-32692ee841f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:45.368869 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933742-7283-40bc-87f8-32692ee841f5 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:45.369145 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933742-7283-40bc-87f8-32692ee841f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:45.369415 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933742-7283-40bc-87f8-32692ee841f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:45.370049 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c933742-7283-40bc-87f8-32692ee841f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:45.370349 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c933742-7283-40bc-87f8-32692ee841f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:45.372011 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c933742-7283-40bc-87f8-32692ee841f5 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:45.383387 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 313/625] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:45.384049 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933742-7283-40bc-87f8-32692ee841f5 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:45.401265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:45.439415 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 313/626] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:45.440818 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc3a91-1bed-4ecc-8d68-1fa168663d5b None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:45.491534 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933742-7283-40bc-87f8-32692ee841f5 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:45.526267 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10b094-6be5-4db8-a555-381abfca1133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:45.526896 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10b094-6be5-4db8-a555-381abfca1133 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:45.527158 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10b094-6be5-4db8-a555-381abfca1133 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:45.527471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10b094-6be5-4db8-a555-381abfca1133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:45.530537 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:45.540533 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10b094-6be5-4db8-a555-381abfca1133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:45.542032 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10b094-6be5-4db8-a555-381abfca1133 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:45.551816 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc3a91-1bed-4ecc-8d68-1fa168663d5b None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-2a10b094-6be5-4db8-a555-381abfca1133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:45.556816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:45.557735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:45.558636 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:45.558636 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:45.558636 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:45.562469 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 314/627] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:45.563306 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10b094-6be5-4db8-a555-381abfca1133 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:45.592220 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcc81c-ef95-4f1f-a8d3-7a6beb2c903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:45.593022 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcc81c-ef95-4f1f-a8d3-7a6beb2c903c None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:45.593229 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcc81c-ef95-4f1f-a8d3-7a6beb2c903c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:45.593502 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcc81c-ef95-4f1f-a8d3-7a6beb2c903c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:45.602061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcc81c-ef95-4f1f-a8d3-7a6beb2c903c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:45.603551 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcc81c-ef95-4f1f-a8d3-7a6beb2c903c None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-8afcc81c-ef95-4f1f-a8d3-7a6beb2c903c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:45.616049 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:45.621805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:45.622928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:45.622928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:45.622928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:45.622928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:45.622928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:45.622928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:45.622928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:45.622928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:45.622928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 314/628] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:45.622928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcc81c-ef95-4f1f-a8d3-7a6beb2c903c None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:45.652128 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:45.686097 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10b094-6be5-4db8-a555-381abfca1133 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:45.721333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b036920-688b-4358-975b-71a5e251d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:45.721910 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b036920-688b-4358-975b-71a5e251d83e None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:45.722196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b036920-688b-4358-975b-71a5e251d83e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:45.722473 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b036920-688b-4358-975b-71a5e251d83e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:45.730222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcc81c-ef95-4f1f-a8d3-7a6beb2c903c None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:45.733234 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b036920-688b-4358-975b-71a5e251d83e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:45.734722 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b036920-688b-4358-975b-71a5e251d83e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-5b036920-688b-4358-975b-71a5e251d83e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:45.749301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:45.750432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:45.751536 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:45.751536 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:45.751536 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:45.755436 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 315/629] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:45.756538 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b036920-688b-4358-975b-71a5e251d83e None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:45.772099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cc7b6-d2cf-4d67-b489-7c4bf8eda3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:45.772879 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cc7b6-d2cf-4d67-b489-7c4bf8eda3eb None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:45.773322 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cc7b6-d2cf-4d67-b489-7c4bf8eda3eb None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:45.773733 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cc7b6-d2cf-4d67-b489-7c4bf8eda3eb None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:45.774563 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cc7b6-d2cf-4d67-b489-7c4bf8eda3eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:45.775017 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cc7b6-d2cf-4d67-b489-7c4bf8eda3eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:45.776598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cc7b6-d2cf-4d67-b489-7c4bf8eda3eb None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:45.788574 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 315/630] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:45.789506 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cc7b6-d2cf-4d67-b489-7c4bf8eda3eb None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:45.803982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:45.866003 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b036920-688b-4358-975b-71a5e251d83e None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:45.881945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:45.900056 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cc7b6-d2cf-4d67-b489-7c4bf8eda3eb None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:45.902670 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995002ea-b1aa-43c5-8588-be3c00d67846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:45.903420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995002ea-b1aa-43c5-8588-be3c00d67846 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:45.903799 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995002ea-b1aa-43c5-8588-be3c00d67846 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:45.904171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995002ea-b1aa-43c5-8588-be3c00d67846 None admin] PATH_INFO: `/v3/projects` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:45.904952 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995002ea-b1aa-43c5-8588-be3c00d67846 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:45.905357 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995002ea-b1aa-43c5-8588-be3c00d67846 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:45.906878 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995002ea-b1aa-43c5-8588-be3c00d67846 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:45.923670 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 316/631] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:45.923670 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995002ea-b1aa-43c5-8588-be3c00d67846 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:45.939790 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60457d5-ee8e-406f-b881-4c586ac0ffb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:45.940487 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60457d5-ee8e-406f-b881-4c586ac0ffb5 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:45.941357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60457d5-ee8e-406f-b881-4c586ac0ffb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:45.941701 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60457d5-ee8e-406f-b881-4c586ac0ffb5 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:45.942416 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60457d5-ee8e-406f-b881-4c586ac0ffb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:45.942892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60457d5-ee8e-406f-b881-4c586ac0ffb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:45.944379 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60457d5-ee8e-406f-b881-4c586ac0ffb5 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:45.957263 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 316/632] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:45.962507 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60457d5-ee8e-406f-b881-4c586ac0ffb5 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:46.023081 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:46.026645 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995002ea-b1aa-43c5-8588-be3c00d67846 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:46.065075 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd888be-4fee-4189-a2b2-57cee419870a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:46.066711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd888be-4fee-4189-a2b2-57cee419870a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:46.067322 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd888be-4fee-4189-a2b2-57cee419870a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:46.067661 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd888be-4fee-4189-a2b2-57cee419870a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:46.076439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd888be-4fee-4189-a2b2-57cee419870a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:46.077805 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60457d5-ee8e-406f-b881-4c586ac0ffb5 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:46.078005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd888be-4fee-4189-a2b2-57cee419870a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-6cd888be-4fee-4189-a2b2-57cee419870a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:46.092724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:46.093817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:46.094966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:46.094966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:46.094966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:46.094966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:46.094966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:46.094966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:46.094966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:46.094966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:46.098682 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 317/633] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:46.099830 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd888be-4fee-4189-a2b2-57cee419870a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:46.117669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc618f34-d898-4bbf-92be-ae4c287cb5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:46.118387 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc618f34-d898-4bbf-92be-ae4c287cb5b2 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:46.118733 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc618f34-d898-4bbf-92be-ae4c287cb5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:46.119392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc618f34-d898-4bbf-92be-ae4c287cb5b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:46.119944 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc618f34-d898-4bbf-92be-ae4c287cb5b2 None admin] RBAC: Adding query filter params (role.id=c1a49401a509407295b9fff1cf635344, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=255b174cea9f41f6970978c44bec2b8f) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:46.120374 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc618f34-d898-4bbf-92be-ae4c287cb5b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:46.121885 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc618f34-d898-4bbf-92be-ae4c287cb5b2 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:46.128014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 317/634] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:01:45 2022] GET /identity/v3/role_assignments?user.id=255b174cea9f41f6970978c44bec2b8f&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=c1a49401a509407295b9fff1cf635344 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:46.137461 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc618f34-d898-4bbf-92be-ae4c287cb5b2 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:46.162542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:46.219943 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd888be-4fee-4189-a2b2-57cee419870a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:46.270169 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58749b-e88d-497b-8295-0df58e99bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:46.271411 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58749b-e88d-497b-8295-0df58e99bb7f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:46.271866 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58749b-e88d-497b-8295-0df58e99bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:46.272697 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58749b-e88d-497b-8295-0df58e99bb7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:46.283226 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58749b-e88d-497b-8295-0df58e99bb7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:46.286130 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58749b-e88d-497b-8295-0df58e99bb7f None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:46.289714 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc618f34-d898-4bbf-92be-ae4c287cb5b2 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-8e58749b-e88d-497b-8295-0df58e99bb7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:46.302199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:46.303338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:46.304618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:46.304618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:46.304618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:46.304618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:46.304618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:46.304618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:46.304618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:46.304618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:46.306363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 318/635] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:46.312334 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58749b-e88d-497b-8295-0df58e99bb7f None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:46.338252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a77794-b7b8-465a-b5f5-a7dc8cde6aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:46.339168 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:46.340106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a77794-b7b8-465a-b5f5-a7dc8cde6aa2 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:46.340561 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a77794-b7b8-465a-b5f5-a7dc8cde6aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:46.342360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a77794-b7b8-465a-b5f5-a7dc8cde6aa2 None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:46.342360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a77794-b7b8-465a-b5f5-a7dc8cde6aa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:46.342360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a77794-b7b8-465a-b5f5-a7dc8cde6aa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:46.345865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a77794-b7b8-465a-b5f5-a7dc8cde6aa2 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:46.362505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 318/636] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:46.369437 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a77794-b7b8-465a-b5f5-a7dc8cde6aa2 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:46.451222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58749b-e88d-497b-8295-0df58e99bb7f None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:46.452192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:46.488355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a77794-b7b8-465a-b5f5-a7dc8cde6aa2 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:46.498446 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab123af0-dbba-465f-840f-d0d419bdb945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:46.499648 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123af0-dbba-465f-840f-d0d419bdb945 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:46.500039 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123af0-dbba-465f-840f-d0d419bdb945 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:46.500414 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123af0-dbba-465f-840f-d0d419bdb945 None admin] PATH_INFO: `/v3/projects` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:46.501581 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab123af0-dbba-465f-840f-d0d419bdb945 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:46.502005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab123af0-dbba-465f-840f-d0d419bdb945 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:46.504641 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab123af0-dbba-465f-840f-d0d419bdb945 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:46.521178 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 319/637] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:46.531367 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab123af0-dbba-465f-840f-d0d419bdb945 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:46.535743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17cca4-37d3-4ff8-ac03-68a5e4d2e87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:46.536287 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cca4-37d3-4ff8-ac03-68a5e4d2e87f None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:46.536564 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cca4-37d3-4ff8-ac03-68a5e4d2e87f None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:46.536835 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cca4-37d3-4ff8-ac03-68a5e4d2e87f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:46.538180 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17cca4-37d3-4ff8-ac03-68a5e4d2e87f None admin] RBAC: Adding query filter params (role.id=c1a49401a509407295b9fff1cf635344, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=3510dd48a215455fb55bfbec820c7f3c) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:46.538518 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17cca4-37d3-4ff8-ac03-68a5e4d2e87f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:46.541137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17cca4-37d3-4ff8-ac03-68a5e4d2e87f None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:46.550636 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 319/638] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:01:46 2022] GET /identity/v3/role_assignments?user.id=3510dd48a215455fb55bfbec820c7f3c&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=c1a49401a509407295b9fff1cf635344 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:46.637361 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:46.660193 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab123af0-dbba-465f-840f-d0d419bdb945 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:46.699936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4e6c1-8255-42f3-bc9f-03a41a3311f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:46.700617 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4e6c1-8255-42f3-bc9f-03a41a3311f5 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:46.700903 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4e6c1-8255-42f3-bc9f-03a41a3311f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:46.701168 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4e6c1-8255-42f3-bc9f-03a41a3311f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:46.701900 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4e6c1-8255-42f3-bc9f-03a41a3311f5 None admin] RBAC: Adding query filter params (role.id=c1a49401a509407295b9fff1cf635344, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=b9326ebc83a2471a856f668ee77285c5) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:46.702205 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4e6c1-8255-42f3-bc9f-03a41a3311f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:46.703708 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4e6c1-8255-42f3-bc9f-03a41a3311f5 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:46.711000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 320/639] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:01:46 2022] GET /identity/v3/role_assignments?user.id=b9326ebc83a2471a856f668ee77285c5&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=c1a49401a509407295b9fff1cf635344 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:47.181693 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4a1dc-0739-458c-b58f-ccf3cb7710b6 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:47.182195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4a1dc-0739-458c-b58f-ccf3cb7710b6 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:47.182582 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4a1dc-0739-458c-b58f-ccf3cb7710b6 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:47.184373 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 320/640] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:47.189715 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097c13a-dfed-4696-89d9-737e218f3c18 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:47.190111 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097c13a-dfed-4696-89d9-737e218f3c18 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:47.190526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097c13a-dfed-4696-89d9-737e218f3c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:47.209781 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-8097c13a-dfed-4696-89d9-737e218f3c18 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:47.210986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-8097c13a-dfed-4696-89d9-737e218f3c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:47.282654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 321/641] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:47.631964 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4a1dc-0739-458c-b58f-ccf3cb7710b6 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:47.745727 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4a1dc-0739-458c-b58f-ccf3cb7710b6 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:47.781200 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b79dee-3bbb-4a86-b896-f9808079d1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:47.781824 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b79dee-3bbb-4a86-b896-f9808079d1a4 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:47.782107 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b79dee-3bbb-4a86-b896-f9808079d1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:47.782385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b79dee-3bbb-4a86-b896-f9808079d1a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:47.784388 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:47.796170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b79dee-3bbb-4a86-b896-f9808079d1a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-42b79dee-3bbb-4a86-b896-f9808079d1a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:47.801857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:47.804192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:47.805943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:47.805943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:47.805943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:47.805943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:47.805943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:47.805943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:47.805943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:47.805943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:47.805943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:47.805943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:47.805943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:01:47.805943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:47.805943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 321/642] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:01:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:47.813333 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097c13a-dfed-4696-89d9-737e218f3c18 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:47.895055 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:47.921108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097c13a-dfed-4696-89d9-737e218f3c18 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:47.959669 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c659a9-4f0a-4a40-9690-14f93e11b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:47.960272 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c659a9-4f0a-4a40-9690-14f93e11b060 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:47.960551 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c659a9-4f0a-4a40-9690-14f93e11b060 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:47.960823 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c659a9-4f0a-4a40-9690-14f93e11b060 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:47.961479 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c659a9-4f0a-4a40-9690-14f93e11b060 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:47.961781 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c659a9-4f0a-4a40-9690-14f93e11b060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:47.963140 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c659a9-4f0a-4a40-9690-14f93e11b060 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:47.971956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 322/643] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:47.977444 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b79dee-3bbb-4a86-b896-f9808079d1a4 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:48.084891 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b79dee-3bbb-4a86-b896-f9808079d1a4 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:48.119534 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cb873-5948-48d7-968e-2b5a6d87ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:48.120155 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cb873-5948-48d7-968e-2b5a6d87ec7a None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:48.120435 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cb873-5948-48d7-968e-2b5a6d87ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:48.120702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cb873-5948-48d7-968e-2b5a6d87ec7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:48.132075 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cb873-5948-48d7-968e-2b5a6d87ec7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:48.133528 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cb873-5948-48d7-968e-2b5a6d87ec7a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-e43cb873-5948-48d7-968e-2b5a6d87ec7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:48.148515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:48.150712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:48.152863 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:48.152863 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:48.152863 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:48.152863 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 322/644] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:48.156329 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c659a9-4f0a-4a40-9690-14f93e11b060 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:48.264954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c659a9-4f0a-4a40-9690-14f93e11b060 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:48.299807 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73fcad-e0b0-4dd7-a2b2-dcfac5ea4a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:48.300681 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73fcad-e0b0-4dd7-a2b2-dcfac5ea4a4d None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:48.301113 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73fcad-e0b0-4dd7-a2b2-dcfac5ea4a4d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:48.301535 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73fcad-e0b0-4dd7-a2b2-dcfac5ea4a4d None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:48.302317 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73fcad-e0b0-4dd7-a2b2-dcfac5ea4a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:48.302770 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73fcad-e0b0-4dd7-a2b2-dcfac5ea4a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:48.304348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73fcad-e0b0-4dd7-a2b2-dcfac5ea4a4d None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:48.306901 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:48.319327 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 323/645] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:48.324722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cb873-5948-48d7-968e-2b5a6d87ec7a None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:48.383785 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:48.434463 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cb873-5948-48d7-968e-2b5a6d87ec7a None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:48.468412 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245f55a-8b23-4100-b422-33de555b9d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:48.469039 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f55a-8b23-4100-b422-33de555b9d2f None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:48.469314 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f55a-8b23-4100-b422-33de555b9d2f None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:48.469630 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f55a-8b23-4100-b422-33de555b9d2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:48.478686 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245f55a-8b23-4100-b422-33de555b9d2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:48.480227 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245f55a-8b23-4100-b422-33de555b9d2f None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-a245f55a-8b23-4100-b422-33de555b9d2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:48.492209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:48.493183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:48.494509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:48.494509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:48.494509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:48.494509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:48.494509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:48.494509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:48.494509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:48.494509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:48.494509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:01:48.494509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:48.494509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 323/646] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Aug 18 21:01:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:48.500457 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73fcad-e0b0-4dd7-a2b2-dcfac5ea4a4d None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:48.545862 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51484c-320b-43c5-b295-2a6782c31c32 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:48.546500 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51484c-320b-43c5-b295-2a6782c31c32 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:48.546978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51484c-320b-43c5-b295-2a6782c31c32 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:48.548682 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 324/647] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:01:48.554558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5529a6-d917-4f68-a4f5-a649fb0ea9cd None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:48.555114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5529a6-d917-4f68-a4f5-a649fb0ea9cd None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:48.555629 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5529a6-d917-4f68-a4f5-a649fb0ea9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:48.575403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-4c5529a6-d917-4f68-a4f5-a649fb0ea9cd None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:48.576976 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-4c5529a6-d917-4f68-a4f5-a649fb0ea9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:48.628933 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73fcad-e0b0-4dd7-a2b2-dcfac5ea4a4d None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:48.659668 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 325/648] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:48.668814 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab837c3-615f-46a0-bc42-582c5170a0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:48.669436 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab837c3-615f-46a0-bc42-582c5170a0b3 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:48.669716 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab837c3-615f-46a0-bc42-582c5170a0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:48.669986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab837c3-615f-46a0-bc42-582c5170a0b3 None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:48.670738 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab837c3-615f-46a0-bc42-582c5170a0b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:48.671040 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab837c3-615f-46a0-bc42-582c5170a0b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:48.672564 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab837c3-615f-46a0-bc42-582c5170a0b3 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:48.693976 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 324/649] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Aug 18 21:01:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:48.700697 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5529a6-d917-4f68-a4f5-a649fb0ea9cd None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:48.742173 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:48.817481 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5529a6-d917-4f68-a4f5-a649fb0ea9cd None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:48.839593 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120e6d0-480c-4c5c-8449-4e0e38ae69b6 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:48.840124 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120e6d0-480c-4c5c-8449-4e0e38ae69b6 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:48.840124 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120e6d0-480c-4c5c-8449-4e0e38ae69b6 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:48.841641 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 325/650] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:01:48.847604 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ae75b-73e4-4a82-ba80-e59be9c5e3a5 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:48.847899 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ae75b-73e4-4a82-ba80-e59be9c5e3a5 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:48.848179 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ae75b-73e4-4a82-ba80-e59be9c5e3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:48.855706 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f57b5d-064f-41d3-806e-f675ac2adcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:48.858272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f57b5d-064f-41d3-806e-f675ac2adcbb None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:48.858769 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f57b5d-064f-41d3-806e-f675ac2adcbb None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:48.859242 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f57b5d-064f-41d3-806e-f675ac2adcbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:48.869838 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-3b8ae75b-73e4-4a82-ba80-e59be9c5e3a5 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:48.871027 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-3b8ae75b-73e4-4a82-ba80-e59be9c5e3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:48.937337 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:48.957450 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f57b5d-064f-41d3-806e-f675ac2adcbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:48.960216 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f57b5d-064f-41d3-806e-f675ac2adcbb None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:48.971428 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 326/651] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:48.992472 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ae75b-73e4-4a82-ba80-e59be9c5e3a5 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:48.999020 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:49.095149 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 326/652] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:49.096125 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f57b5d-064f-41d3-806e-f675ac2adcbb None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:49.120110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ae75b-73e4-4a82-ba80-e59be9c5e3a5 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:49.158456 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091e894-3d6a-4b95-b401-d46c5e9b2869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:49.159213 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091e894-3d6a-4b95-b401-d46c5e9b2869 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:49.159539 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091e894-3d6a-4b95-b401-d46c5e9b2869 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:49.159790 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091e894-3d6a-4b95-b401-d46c5e9b2869 None admin] PATH_INFO: `/v3/services/image` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:49.160437 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091e894-3d6a-4b95-b401-d46c5e9b2869 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:49.162023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091e894-3d6a-4b95-b401-d46c5e9b2869 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-c091e894-3d6a-4b95-b401-d46c5e9b2869 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:49.173711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:49.175325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:49.176166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 327/653] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Aug 18 21:01:48 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:01:49.176964 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8a89f-1f98-46ad-9c50-67425c1faf14 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:49.178029 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8a89f-1f98-46ad-9c50-67425c1faf14 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:49.178029 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8a89f-1f98-46ad-9c50-67425c1faf14 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:49.183303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 328/654] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:49.183303 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8a89f-1f98-46ad-9c50-67425c1faf14 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:49.211444 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f57b5d-064f-41d3-806e-f675ac2adcbb None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:49.242696 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:49.248674 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70705c-2a69-4023-94f6-b25bd356e83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:49.249299 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70705c-2a69-4023-94f6-b25bd356e83f None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:49.249582 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70705c-2a69-4023-94f6-b25bd356e83f None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:49.249853 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70705c-2a69-4023-94f6-b25bd356e83f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:49.253458 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:49.263559 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70705c-2a69-4023-94f6-b25bd356e83f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:49.265007 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70705c-2a69-4023-94f6-b25bd356e83f None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-5e70705c-2a69-4023-94f6-b25bd356e83f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:49.279969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:49.280922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:49.282523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:49.282523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:49.282523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:49.282523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 327/655] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:49.282764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab76c-8285-4d2d-9e0f-522e37adb6a9 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:49.282974 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab76c-8285-4d2d-9e0f-522e37adb6a9 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:49.283204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab76c-8285-4d2d-9e0f-522e37adb6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:49.301761 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-31cab76c-8285-4d2d-9e0f-522e37adb6a9 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:49.302997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-31cab76c-8285-4d2d-9e0f-522e37adb6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:49.304051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8a89f-1f98-46ad-9c50-67425c1faf14 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:49.338693 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e8054-55f8-4ced-92f9-53771ce4fd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:49.339451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e8054-55f8-4ced-92f9-53771ce4fd52 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:49.339734 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e8054-55f8-4ced-92f9-53771ce4fd52 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:49.339994 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e8054-55f8-4ced-92f9-53771ce4fd52 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:49.340634 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e8054-55f8-4ced-92f9-53771ce4fd52 None admin] RBAC: Adding query filter params (name=image) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:49.340977 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e8054-55f8-4ced-92f9-53771ce4fd52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:49.342278 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e8054-55f8-4ced-92f9-53771ce4fd52 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:49.346819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 329/656] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:49.347701 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e8054-55f8-4ced-92f9-53771ce4fd52 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:49.374812 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 328/657] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:49.375714 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cab76c-8285-4d2d-9e0f-522e37adb6a9 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:49.458111 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e8054-55f8-4ced-92f9-53771ce4fd52 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:49.471464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:49.481841 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cab76c-8285-4d2d-9e0f-522e37adb6a9 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:49.495713 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd0ba1-c4e4-417a-862d-58d146b7719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:49.496318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd0ba1-c4e4-417a-862d-58d146b7719a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:49.496596 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd0ba1-c4e4-417a-862d-58d146b7719a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:49.497160 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd0ba1-c4e4-417a-862d-58d146b7719a None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:49.497512 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd0ba1-c4e4-417a-862d-58d146b7719a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:49.497818 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd0ba1-c4e4-417a-862d-58d146b7719a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:49.499309 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd0ba1-c4e4-417a-862d-58d146b7719a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:49.501000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:49.516732 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 330/658] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:49.516732 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd0ba1-c4e4-417a-862d-58d146b7719a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:49.525034 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecf66e-9167-4c6c-b83d-7bad3a1115ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:49.525668 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecf66e-9167-4c6c-b83d-7bad3a1115ea None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:49.525955 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecf66e-9167-4c6c-b83d-7bad3a1115ea None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:49.526232 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecf66e-9167-4c6c-b83d-7bad3a1115ea None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:49.526812 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecf66e-9167-4c6c-b83d-7bad3a1115ea None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:49.528212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecf66e-9167-4c6c-b83d-7bad3a1115ea None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-e5ecf66e-9167-4c6c-b83d-7bad3a1115ea None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:49.539009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:49.540219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:49.541100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 329/659] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Aug 18 21:01:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:49.541933 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecf66e-9167-4c6c-b83d-7bad3a1115ea None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:49.630654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd0ba1-c4e4-417a-862d-58d146b7719a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:49.648869 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecf66e-9167-4c6c-b83d-7bad3a1115ea None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:49.667354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af4bae-8f07-4091-89d7-2652ff38193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:49.667953 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af4bae-8f07-4091-89d7-2652ff38193b None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:49.668232 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af4bae-8f07-4091-89d7-2652ff38193b None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:49.668499 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af4bae-8f07-4091-89d7-2652ff38193b None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:49.669152 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af4bae-8f07-4091-89d7-2652ff38193b None admin] RBAC: Adding query filter params (type=image) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:49.669508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af4bae-8f07-4091-89d7-2652ff38193b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:49.670871 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af4bae-8f07-4091-89d7-2652ff38193b None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:49.676812 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 331/660] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:49.677594 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af4bae-8f07-4091-89d7-2652ff38193b None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:49.697129 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179e011-ac89-488e-bb28-7b81eea40cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:49.698379 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e011-ac89-488e-bb28-7b81eea40cdc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:49.698953 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e011-ac89-488e-bb28-7b81eea40cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:49.699236 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e011-ac89-488e-bb28-7b81eea40cdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:49.707336 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179e011-ac89-488e-bb28-7b81eea40cdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:49.708857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179e011-ac89-488e-bb28-7b81eea40cdc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-d179e011-ac89-488e-bb28-7b81eea40cdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:49.721954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:49.722926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:49.723892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:49.723892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:49.723892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:49.723892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:49.723892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:49.723892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:49.723892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:49.723892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:49.723892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 330/661] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:49.724394 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179e011-ac89-488e-bb28-7b81eea40cdc None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:49.729009 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:49.773225 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:49.804020 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af4bae-8f07-4091-89d7-2652ff38193b None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:49.840771 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179e011-ac89-488e-bb28-7b81eea40cdc None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:49.842183 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105bc86-37c2-4702-a5b2-f25ef7369502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:49.842959 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105bc86-37c2-4702-a5b2-f25ef7369502 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:49.843093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105bc86-37c2-4702-a5b2-f25ef7369502 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:49.843392 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105bc86-37c2-4702-a5b2-f25ef7369502 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:49.844691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105bc86-37c2-4702-a5b2-f25ef7369502 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:49.844691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105bc86-37c2-4702-a5b2-f25ef7369502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:49.845885 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105bc86-37c2-4702-a5b2-f25ef7369502 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:49.855699 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 332/662] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Aug 18 21:01:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:49.855699 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105bc86-37c2-4702-a5b2-f25ef7369502 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:49.887331 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6d9b5-b77d-4d14-8599-3caebbe24ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:49.887983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6d9b5-b77d-4d14-8599-3caebbe24ee8 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:49.888240 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6d9b5-b77d-4d14-8599-3caebbe24ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:49.888511 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6d9b5-b77d-4d14-8599-3caebbe24ee8 None admin] PATH_INFO: `/v3/services/network` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:49.889088 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6d9b5-b77d-4d14-8599-3caebbe24ee8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:49.890468 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6d9b5-b77d-4d14-8599-3caebbe24ee8 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-0de6d9b5-b77d-4d14-8599-3caebbe24ee8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:49.899691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:49.900719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:49.901575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 331/663] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:49 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:49.902376 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6d9b5-b77d-4d14-8599-3caebbe24ee8 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:49.968616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:49.972453 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105bc86-37c2-4702-a5b2-f25ef7369502 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:50.009846 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6d9b5-b77d-4d14-8599-3caebbe24ee8 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:50.010187 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbed63-d68d-4339-8946-d71923db35cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:50.010825 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbed63-d68d-4339-8946-d71923db35cd None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:50.011112 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbed63-d68d-4339-8946-d71923db35cd None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:50.011439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbed63-d68d-4339-8946-d71923db35cd None admin] PATH_INFO: `/v3/projects` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:50.012137 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbed63-d68d-4339-8946-d71923db35cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:50.012447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbed63-d68d-4339-8946-d71923db35cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:50.013889 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbed63-d68d-4339-8946-d71923db35cd None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:50.018476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:50.027322 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 333/664] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:50.027655 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbed63-d68d-4339-8946-d71923db35cd None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:50.055961 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60161c9-099f-4d26-8dd8-8eccab40997c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:50.056567 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60161c9-099f-4d26-8dd8-8eccab40997c None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:50.056847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60161c9-099f-4d26-8dd8-8eccab40997c None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:50.057120 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60161c9-099f-4d26-8dd8-8eccab40997c None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:50.057752 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60161c9-099f-4d26-8dd8-8eccab40997c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:50.058129 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60161c9-099f-4d26-8dd8-8eccab40997c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:50.059651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60161c9-099f-4d26-8dd8-8eccab40997c None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:50.065856 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 332/665] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Aug 18 21:01:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:50.066189 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60161c9-099f-4d26-8dd8-8eccab40997c None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:50.171997 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbed63-d68d-4339-8946-d71923db35cd None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:50.190636 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60161c9-099f-4d26-8dd8-8eccab40997c None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:50.225093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37120c35-b677-4f1c-8706-635f8ac462b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:50.225948 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37120c35-b677-4f1c-8706-635f8ac462b1 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:50.226481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37120c35-b677-4f1c-8706-635f8ac462b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:50.226846 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37120c35-b677-4f1c-8706-635f8ac462b1 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:50.227658 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37120c35-b677-4f1c-8706-635f8ac462b1 None admin] RBAC: Adding query filter params (name=network) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:50.227762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510023a-c6c2-4474-9ca8-dae6c83030e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:50.228038 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37120c35-b677-4f1c-8706-635f8ac462b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:50.228302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510023a-c6c2-4474-9ca8-dae6c83030e0 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:50.228638 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510023a-c6c2-4474-9ca8-dae6c83030e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:50.228927 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510023a-c6c2-4474-9ca8-dae6c83030e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:50.229666 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510023a-c6c2-4474-9ca8-dae6c83030e0 None admin] RBAC: Adding query filter params (role.id=49c7d15532d94cafac420a6bcf8574ad, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=ba197525d2af40528f7cbe7de9da9a23) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:50.229767 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37120c35-b677-4f1c-8706-635f8ac462b1 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:50.229975 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510023a-c6c2-4474-9ca8-dae6c83030e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:50.231465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510023a-c6c2-4474-9ca8-dae6c83030e0 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:50.236175 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 334/666] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Aug 18 21:01:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:50.241370 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 333/667] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:01:50 2022] GET /identity/v3/role_assignments?user.id=ba197525d2af40528f7cbe7de9da9a23&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=49c7d15532d94cafac420a6bcf8574ad => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:50.242462 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37120c35-b677-4f1c-8706-635f8ac462b1 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:50.276470 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:50.368587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37120c35-b677-4f1c-8706-635f8ac462b1 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:50.408337 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262da02a-e6f4-49d5-af6a-d93c0ecd1473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:50.408984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262da02a-e6f4-49d5-af6a-d93c0ecd1473 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:50.409453 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262da02a-e6f4-49d5-af6a-d93c0ecd1473 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:50.409734 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262da02a-e6f4-49d5-af6a-d93c0ecd1473 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:50.410385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262da02a-e6f4-49d5-af6a-d93c0ecd1473 None admin] RBAC: Adding query filter params (type=network) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:50.410693 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262da02a-e6f4-49d5-af6a-d93c0ecd1473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:50.412158 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262da02a-e6f4-49d5-af6a-d93c0ecd1473 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:50.417881 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 335/668] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Aug 18 21:01:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:51.918455 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc16800-8d40-4e17-b47e-3ec6c439413e None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:51.918950 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc16800-8d40-4e17-b47e-3ec6c439413e None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:51.918950 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc16800-8d40-4e17-b47e-3ec6c439413e None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:51.920527 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 334/669] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:51.926088 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f50437-8b57-4725-a997-3ee171c3319e None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:51.926546 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f50437-8b57-4725-a997-3ee171c3319e None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:51.926629 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f50437-8b57-4725-a997-3ee171c3319e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:51.945310 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-c7f50437-8b57-4725-a997-3ee171c3319e None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:51.946765 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-c7f50437-8b57-4725-a997-3ee171c3319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:52.024501 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 336/670] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:52.351823 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc16800-8d40-4e17-b47e-3ec6c439413e None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:52.360952 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a222d-931f-4942-a6a1-f07e5bc9f56f None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:52.361235 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a222d-931f-4942-a6a1-f07e5bc9f56f None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:52.361508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a222d-931f-4942-a6a1-f07e5bc9f56f None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:52.363437 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 337/671] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:01:52.369886 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d82e38-d8f4-414c-a6b3-ea634ec5dd22 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:52.370188 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d82e38-d8f4-414c-a6b3-ea634ec5dd22 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:52.370589 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d82e38-d8f4-414c-a6b3-ea634ec5dd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:52.396413 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-27d82e38-d8f4-414c-a6b3-ea634ec5dd22 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:52.397633 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-27d82e38-d8f4-414c-a6b3-ea634ec5dd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:52.404673 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:52.413454 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:52.475502 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 338/672] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:52.482104 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc16800-8d40-4e17-b47e-3ec6c439413e None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:52.498203 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2d5b-8231-4d8f-9ff3-93cdb45f474a None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:52.498635 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2d5b-8231-4d8f-9ff3-93cdb45f474a None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:52.498980 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2d5b-8231-4d8f-9ff3-93cdb45f474a None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:52.500498 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 339/673] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:01:52.507030 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93448fb8-f0d8-4fcf-8016-7d63d100b77b None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:52.507448 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93448fb8-f0d8-4fcf-8016-7d63d100b77b None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:52.507794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93448fb8-f0d8-4fcf-8016-7d63d100b77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:52.528019 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-93448fb8-f0d8-4fcf-8016-7d63d100b77b None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:52.529212 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-93448fb8-f0d8-4fcf-8016-7d63d100b77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:52.531779 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79192e-5414-49a8-bd47-e4f71b49f2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:52.532390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79192e-5414-49a8-bd47-e4f71b49f2e7 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:52.532671 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79192e-5414-49a8-bd47-e4f71b49f2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:52.532992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79192e-5414-49a8-bd47-e4f71b49f2e7 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:52.533590 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79192e-5414-49a8-bd47-e4f71b49f2e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:52.534990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79192e-5414-49a8-bd47-e4f71b49f2e7 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:52.553382 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 335/674] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Aug 18 21:01:52 2022] POST /identity/v3/services => generated 242 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:01:52.622858 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 340/675] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:52 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:52.668091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937ac74-03fc-44de-81ea-69f72ce4f573 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:52.668764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937ac74-03fc-44de-81ea-69f72ce4f573 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:52.669250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937ac74-03fc-44de-81ea-69f72ce4f573 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:52.671100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 336/676] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:52.677538 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ecd28-58ff-4c88-b1df-6673f2357da8 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:52.678147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ecd28-58ff-4c88-b1df-6673f2357da8 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:52.678625 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ecd28-58ff-4c88-b1df-6673f2357da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:52.698359 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-095ecd28-58ff-4c88-b1df-6673f2357da8 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:52.699968 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-095ecd28-58ff-4c88-b1df-6673f2357da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:52.773219 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 341/677] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:52 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:01:52.922755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937ac74-03fc-44de-81ea-69f72ce4f573 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:52.968515 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ecd28-58ff-4c88-b1df-6673f2357da8 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:52.973417 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:53.027548 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:53.038993 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937ac74-03fc-44de-81ea-69f72ce4f573 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:53.076105 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcaae3-7e1b-4de9-89b6-964963029766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:53.076801 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcaae3-7e1b-4de9-89b6-964963029766 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:53.077088 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcaae3-7e1b-4de9-89b6-964963029766 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:53.077358 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcaae3-7e1b-4de9-89b6-964963029766 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:53.078061 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcaae3-7e1b-4de9-89b6-964963029766 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:53.079585 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcaae3-7e1b-4de9-89b6-964963029766 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:53.092973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ecd28-58ff-4c88-b1df-6673f2357da8 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:53.095716 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 337/678] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Aug 18 21:01:52 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:01:53.110752 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcaae3-7e1b-4de9-89b6-964963029766 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:53.141963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54a08f-9fc2-45e8-8e7c-b71eef9cfa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:53.142694 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54a08f-9fc2-45e8-8e7c-b71eef9cfa2f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:53.142982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54a08f-9fc2-45e8-8e7c-b71eef9cfa2f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:53.143979 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54a08f-9fc2-45e8-8e7c-b71eef9cfa2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:53.156761 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54a08f-9fc2-45e8-8e7c-b71eef9cfa2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-ed54a08f-9fc2-45e8-8e7c-b71eef9cfa2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:53.163204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:53.164225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:53.165072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:53.165072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:53.165072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:53.165072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:53.165072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:53.165072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:53.165072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:53.165072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:53.165072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:53.165072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:53.165072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:01:53.165072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:53.169449 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 342/679] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:53.170807 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54a08f-9fc2-45e8-8e7c-b71eef9cfa2f None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:53.233089 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcaae3-7e1b-4de9-89b6-964963029766 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:53.250086 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:53.276674 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffbb57-550e-45f5-8409-38553df26038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:53.277353 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffbb57-550e-45f5-8409-38553df26038 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:53.277636 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffbb57-550e-45f5-8409-38553df26038 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:53.278035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffbb57-550e-45f5-8409-38553df26038 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:53.278722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffbb57-550e-45f5-8409-38553df26038 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:53.280283 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffbb57-550e-45f5-8409-38553df26038 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:53.298359 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 338/680] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Aug 18 21:01:53 2022] POST /identity/v3/services => generated 240 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:01:53.300751 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54a08f-9fc2-45e8-8e7c-b71eef9cfa2f None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:53.351473 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116d19c-1244-407b-aeb0-85fcc0a15936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:53.352130 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116d19c-1244-407b-aeb0-85fcc0a15936 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:53.352411 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116d19c-1244-407b-aeb0-85fcc0a15936 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:53.352683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116d19c-1244-407b-aeb0-85fcc0a15936 None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:53.353351 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116d19c-1244-407b-aeb0-85fcc0a15936 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:53.353680 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116d19c-1244-407b-aeb0-85fcc0a15936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:53.355134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116d19c-1244-407b-aeb0-85fcc0a15936 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:53.366878 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 343/681] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:53.372652 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffbb57-550e-45f5-8409-38553df26038 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:53.395900 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:53.506120 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffbb57-550e-45f5-8409-38553df26038 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:53.542461 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bd60f-7e71-40ec-a147-f1e1afdf3de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:53.543511 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bd60f-7e71-40ec-a147-f1e1afdf3de6 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:53.544066 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bd60f-7e71-40ec-a147-f1e1afdf3de6 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:53.544529 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bd60f-7e71-40ec-a147-f1e1afdf3de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:53.556566 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bd60f-7e71-40ec-a147-f1e1afdf3de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:53.558346 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bd60f-7e71-40ec-a147-f1e1afdf3de6 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-df2bd60f-7e71-40ec-a147-f1e1afdf3de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:53.574203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:53.575192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:53.576138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:53.576138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:53.576138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:53.577947 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 339/682] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:53.583391 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116d19c-1244-407b-aeb0-85fcc0a15936 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:53.692729 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116d19c-1244-407b-aeb0-85fcc0a15936 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:53.717280 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:53.730821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1f6c3-e964-43e5-831d-3e9214a78c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:53.731474 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1f6c3-e964-43e5-831d-3e9214a78c3f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:53.731765 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1f6c3-e964-43e5-831d-3e9214a78c3f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:53.732030 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1f6c3-e964-43e5-831d-3e9214a78c3f None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:53.732678 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1f6c3-e964-43e5-831d-3e9214a78c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:53.732982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1f6c3-e964-43e5-831d-3e9214a78c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:53.734359 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1f6c3-e964-43e5-831d-3e9214a78c3f None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:53.747688 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 344/683] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:53.754549 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bd60f-7e71-40ec-a147-f1e1afdf3de6 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:53.826108 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:53.862567 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bd60f-7e71-40ec-a147-f1e1afdf3de6 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:53.897997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfbc5e-0679-40c3-981a-36082b001bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:53.898634 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfbc5e-0679-40c3-981a-36082b001bec None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:53.898918 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfbc5e-0679-40c3-981a-36082b001bec None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:53.899195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfbc5e-0679-40c3-981a-36082b001bec None admin] PATH_INFO: `/v3/users/nova` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:53.907065 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfbc5e-0679-40c3-981a-36082b001bec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:53.908546 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfbc5e-0679-40c3-981a-36082b001bec None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-1acfbc5e-0679-40c3-981a-36082b001bec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:53.919724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:53.920683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:53.921635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:53.921635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:53.921635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:53.921635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:53.921635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:53.921635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:53.921635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:53.921635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:53.921635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:01:53.921635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:53.921635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 340/684] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Aug 18 21:01:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:53.926508 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1f6c3-e964-43e5-831d-3e9214a78c3f None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:54.037227 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1f6c3-e964-43e5-831d-3e9214a78c3f None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:54.071930 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abf25e-3f99-49a6-abca-f889a2a0c279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:54.072596 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abf25e-3f99-49a6-abca-f889a2a0c279 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:54.072878 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abf25e-3f99-49a6-abca-f889a2a0c279 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:54.073149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abf25e-3f99-49a6-abca-f889a2a0c279 None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:54.073872 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abf25e-3f99-49a6-abca-f889a2a0c279 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:54.074176 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abf25e-3f99-49a6-abca-f889a2a0c279 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:54.075617 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abf25e-3f99-49a6-abca-f889a2a0c279 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:54.093621 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 345/685] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Aug 18 21:01:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:54.099388 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfbc5e-0679-40c3-981a-36082b001bec None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:54.200059 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfbc5e-0679-40c3-981a-36082b001bec None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:54.225617 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:54.235713 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df8cbf-48c6-4ddb-b28e-f0488e8d7fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:54.236336 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df8cbf-48c6-4ddb-b28e-f0488e8d7fbd None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:54.236612 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df8cbf-48c6-4ddb-b28e-f0488e8d7fbd None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:54.236993 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df8cbf-48c6-4ddb-b28e-f0488e8d7fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:54.247497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df8cbf-48c6-4ddb-b28e-f0488e8d7fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:54.248982 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df8cbf-48c6-4ddb-b28e-f0488e8d7fbd None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-08df8cbf-48c6-4ddb-b28e-f0488e8d7fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:54.262834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:54.265021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:54.267160 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:54.267160 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:54.267160 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:54.267599 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 341/686] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:54.270539 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abf25e-3f99-49a6-abca-f889a2a0c279 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:54.307782 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:54.381529 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abf25e-3f99-49a6-abca-f889a2a0c279 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:54.417012 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54667a-b3ee-4c8e-a94a-c2c37b7ce464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:54.417642 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54667a-b3ee-4c8e-a94a-c2c37b7ce464 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:54.417924 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54667a-b3ee-4c8e-a94a-c2c37b7ce464 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:54.418202 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54667a-b3ee-4c8e-a94a-c2c37b7ce464 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:54.418864 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54667a-b3ee-4c8e-a94a-c2c37b7ce464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:54.419172 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54667a-b3ee-4c8e-a94a-c2c37b7ce464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:54.420634 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54667a-b3ee-4c8e-a94a-c2c37b7ce464 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:54.435005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 346/687] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:54.441435 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df8cbf-48c6-4ddb-b28e-f0488e8d7fbd None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:54.549128 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df8cbf-48c6-4ddb-b28e-f0488e8d7fbd None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:54.588169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aedcd8-f95a-4eaf-a0c7-1039b524fda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:54.588831 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aedcd8-f95a-4eaf-a0c7-1039b524fda3 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:54.589112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aedcd8-f95a-4eaf-a0c7-1039b524fda3 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:54.589381 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aedcd8-f95a-4eaf-a0c7-1039b524fda3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:54.601591 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aedcd8-f95a-4eaf-a0c7-1039b524fda3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:54.603048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aedcd8-f95a-4eaf-a0c7-1039b524fda3 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-b9aedcd8-f95a-4eaf-a0c7-1039b524fda3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:54.616471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:54.617386 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:54.618296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:54.618296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:54.618296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:54.618296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:54.618296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:54.618296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:54.618296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:54.618296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:54.622325 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 342/688] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:54.623772 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54667a-b3ee-4c8e-a94a-c2c37b7ce464 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:54.727842 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:54.734299 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54667a-b3ee-4c8e-a94a-c2c37b7ce464 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:54.770766 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da73ef4-2718-4d56-b5a8-b32ffe7ad56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:54.771403 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da73ef4-2718-4d56-b5a8-b32ffe7ad56e None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:54.771687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da73ef4-2718-4d56-b5a8-b32ffe7ad56e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:54.771959 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da73ef4-2718-4d56-b5a8-b32ffe7ad56e None admin] PATH_INFO: `/v3/projects` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:54.772639 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da73ef4-2718-4d56-b5a8-b32ffe7ad56e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:54.772941 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da73ef4-2718-4d56-b5a8-b32ffe7ad56e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:54.774361 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da73ef4-2718-4d56-b5a8-b32ffe7ad56e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:54.787117 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 347/689] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:54.792780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aedcd8-f95a-4eaf-a0c7-1039b524fda3 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:54.838818 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:54.901986 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aedcd8-f95a-4eaf-a0c7-1039b524fda3 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:54.937131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87cb67-b208-4907-a44e-f0d89834aaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:54.937788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87cb67-b208-4907-a44e-f0d89834aaac None admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:54.938072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87cb67-b208-4907-a44e-f0d89834aaac None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:54.938347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87cb67-b208-4907-a44e-f0d89834aaac None admin] PATH_INFO: `/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/ba197525d2af40528f7cbe7de9da9a23/roles/49c7d15532d94cafac420a6bcf8574ad` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:54.940864 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87cb67-b208-4907-a44e-f0d89834aaac None admin] RBAC: Authorizing `identity:create_grant(project_id=55812d15e0dc4e75bb9a31abfa3387bf, user_id=ba197525d2af40528f7cbe7de9da9a23, role_id=49c7d15532d94cafac420a6bcf8574ad)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:54.942303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87cb67-b208-4907-a44e-f0d89834aaac None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:54.958821 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 343/690] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:01:54 2022] PUT /identity/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/ba197525d2af40528f7cbe7de9da9a23/roles/49c7d15532d94cafac420a6bcf8574ad => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:54.969165 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4dcd-44b2-48e5-a549-759d4fdcf884 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:54.969492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4dcd-44b2-48e5-a549-759d4fdcf884 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:54.969708 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4dcd-44b2-48e5-a549-759d4fdcf884 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:54.971450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 348/691] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:54.977102 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45b0e3-7ebb-4b8b-9cfa-89b4f173100e None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:54.977739 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45b0e3-7ebb-4b8b-9cfa-89b4f173100e None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:54.978293 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45b0e3-7ebb-4b8b-9cfa-89b4f173100e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:54.999335 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-9d45b0e3-7ebb-4b8b-9cfa-89b4f173100e None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:55.000632 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-9d45b0e3-7ebb-4b8b-9cfa-89b4f173100e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:55.081304 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 344/692] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:54 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:01:55.412657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4dcd-44b2-48e5-a549-759d4fdcf884 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:55.523911 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4dcd-44b2-48e5-a549-759d4fdcf884 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:55.562237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0513ab-e7a6-4903-96a6-b71ee91ca8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:55.562892 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0513ab-e7a6-4903-96a6-b71ee91ca8a4 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:55.563176 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0513ab-e7a6-4903-96a6-b71ee91ca8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:55.563484 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0513ab-e7a6-4903-96a6-b71ee91ca8a4 None admin] PATH_INFO: `/v3/services/image` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:55.564109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0513ab-e7a6-4903-96a6-b71ee91ca8a4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:55.566251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0513ab-e7a6-4903-96a6-b71ee91ca8a4 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-0c0513ab-e7a6-4903-96a6-b71ee91ca8a4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:55.578822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:55.579995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:55.581439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 349/693] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Aug 18 21:01:55 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:55.591097 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45b0e3-7ebb-4b8b-9cfa-89b4f173100e None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:55.602479 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a94c91-6900-435d-9456-9d4f32c9ce60 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:55.602804 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a94c91-6900-435d-9456-9d4f32c9ce60 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:55.603045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a94c91-6900-435d-9456-9d4f32c9ce60 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:55.604774 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 350/694] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:01:55.609704 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b2f83-f415-4d56-84f5-f2b786bfeae2 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:55.609995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b2f83-f415-4d56-84f5-f2b786bfeae2 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:55.610268 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b2f83-f415-4d56-84f5-f2b786bfeae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:55.629358 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:55.715826 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45b0e3-7ebb-4b8b-9cfa-89b4f173100e None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:55.750023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-670b2f83-f415-4d56-84f5-f2b786bfeae2 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:55.751230 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-670b2f83-f415-4d56-84f5-f2b786bfeae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:55.757614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc334d2d-4e46-4ef2-83e4-57f596fe7796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:55.758228 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc334d2d-4e46-4ef2-83e4-57f596fe7796 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:55.758511 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc334d2d-4e46-4ef2-83e4-57f596fe7796 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:55.758785 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc334d2d-4e46-4ef2-83e4-57f596fe7796 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:55.759448 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc334d2d-4e46-4ef2-83e4-57f596fe7796 None admin] RBAC: Adding query filter params (name=image) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:55.759760 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc334d2d-4e46-4ef2-83e4-57f596fe7796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:55.761132 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc334d2d-4e46-4ef2-83e4-57f596fe7796 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:55.765963 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 345/695] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:55.767028 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace83a66-eab6-4690-891f-bcef134d1cc7 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:55.767409 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace83a66-eab6-4690-891f-bcef134d1cc7 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:55.767607 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace83a66-eab6-4690-891f-bcef134d1cc7 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:55.768091 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:55.769067 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 346/696] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:55.773989 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace83a66-eab6-4690-891f-bcef134d1cc7 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:55.829707 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 351/697] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:55 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:01:55.831383 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89609fa5-30fa-403d-8394-2914edea5c70 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:55.831903 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89609fa5-30fa-403d-8394-2914edea5c70 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:55.832386 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89609fa5-30fa-403d-8394-2914edea5c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:55.859559 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-89609fa5-30fa-403d-8394-2914edea5c70 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:55.862112 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-89609fa5-30fa-403d-8394-2914edea5c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:55.879096 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:55.890069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace83a66-eab6-4690-891f-bcef134d1cc7 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:55.926205 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dcb45-85a2-46f0-81e8-0c8c64cd8bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:55.926809 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dcb45-85a2-46f0-81e8-0c8c64cd8bb1 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:55.927143 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dcb45-85a2-46f0-81e8-0c8c64cd8bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:55.927548 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dcb45-85a2-46f0-81e8-0c8c64cd8bb1 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:55.928218 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61dcb45-85a2-46f0-81e8-0c8c64cd8bb1 None admin] RBAC: Adding query filter params (type=image) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:55.928525 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61dcb45-85a2-46f0-81e8-0c8c64cd8bb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:55.929892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61dcb45-85a2-46f0-81e8-0c8c64cd8bb1 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:55.939724 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 347/698] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:55.942432 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dcb45-85a2-46f0-81e8-0c8c64cd8bb1 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:55.957002 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 352/699] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:55 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:01:56.047844 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dcb45-85a2-46f0-81e8-0c8c64cd8bb1 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:56.084774 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb2aed-fd39-4012-b56c-ba54f7e0cf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:56.085713 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb2aed-fd39-4012-b56c-ba54f7e0cf43 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.086213 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb2aed-fd39-4012-b56c-ba54f7e0cf43 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.086706 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb2aed-fd39-4012-b56c-ba54f7e0cf43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.087646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb2aed-fd39-4012-b56c-ba54f7e0cf43 None admin] RBAC: Adding query filter params (interface=public, service_id=1123227e63d74313bc4a5865af90b450, region_id=RegionOne) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:56.088153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb2aed-fd39-4012-b56c-ba54f7e0cf43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:56.089720 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb2aed-fd39-4012-b56c-ba54f7e0cf43 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:56.098354 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 348/700] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Aug 18 21:01:55 2022] GET /identity/v3/endpoints?service_id=1123227e63d74313bc4a5865af90b450&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:56.104380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89609fa5-30fa-403d-8394-2914edea5c70 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:56.189343 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb2aed-fd39-4012-b56c-ba54f7e0cf43 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:56.191834 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:56.211586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89609fa5-30fa-403d-8394-2914edea5c70 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:56.246375 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c93811-669d-4058-b812-e6bf313ab6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:56.246970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c93811-669d-4058-b812-e6bf313ab6ad None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.247248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c93811-669d-4058-b812-e6bf313ab6ad None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.247571 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c93811-669d-4058-b812-e6bf313ab6ad None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.248173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c93811-669d-4058-b812-e6bf313ab6ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:56.249535 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c93811-669d-4058-b812-e6bf313ab6ad None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:56.255280 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 353/701] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Aug 18 21:01:56 2022] GET /identity/v3/services => generated 1002 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:01:56.262094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:56.313916 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb2aed-fd39-4012-b56c-ba54f7e0cf43 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:56.320011 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c93811-669d-4058-b812-e6bf313ab6ad None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:56.360050 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef8129-148a-4781-9300-cb86e29ee3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:56.361050 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef8129-148a-4781-9300-cb86e29ee3a2 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.362922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef8129-148a-4781-9300-cb86e29ee3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.363211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef8129-148a-4781-9300-cb86e29ee3a2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.363844 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef8129-148a-4781-9300-cb86e29ee3a2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:56.365258 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef8129-148a-4781-9300-cb86e29ee3a2 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-8aef8129-148a-4781-9300-cb86e29ee3a2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:56.378349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:56.379427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:01:56.380282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:56.381018 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 349/702] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Aug 18 21:01:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:01:56.386342 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef8129-148a-4781-9300-cb86e29ee3a2 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:56.447414 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c93811-669d-4058-b812-e6bf313ab6ad None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:56.489811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c5876-9d12-4ce1-b290-bbe0de74e2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:56.490526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c5876-9d12-4ce1-b290-bbe0de74e2ac None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.490895 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c5876-9d12-4ce1-b290-bbe0de74e2ac None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.491212 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c5876-9d12-4ce1-b290-bbe0de74e2ac None admin] PATH_INFO: `/v3/services/network` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.491921 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c5876-9d12-4ce1-b290-bbe0de74e2ac None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:56.493451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c5876-9d12-4ce1-b290-bbe0de74e2ac None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:56.501356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-0e7c5876-9d12-4ce1-b290-bbe0de74e2ac None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:56.503620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:56.504602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:56.505458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 354/703] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:56 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:01:56.510950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c5876-9d12-4ce1-b290-bbe0de74e2ac None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:56.519917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef8129-148a-4781-9300-cb86e29ee3a2 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:56.525600 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:56.555768 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ab11b-3e16-4c3a-9733-7e0b4ec2a5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:56.556334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ab11b-3e16-4c3a-9733-7e0b4ec2a5bf None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.556634 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ab11b-3e16-4c3a-9733-7e0b4ec2a5bf None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.556887 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ab11b-3e16-4c3a-9733-7e0b4ec2a5bf None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.557503 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ab11b-3e16-4c3a-9733-7e0b4ec2a5bf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:56.557809 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ab11b-3e16-4c3a-9733-7e0b4ec2a5bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:56.559181 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ab11b-3e16-4c3a-9733-7e0b4ec2a5bf None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:56.570748 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 350/704] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Aug 18 21:01:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:56.573638 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ab11b-3e16-4c3a-9733-7e0b4ec2a5bf None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:56.651767 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c5876-9d12-4ce1-b290-bbe0de74e2ac None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:56.690726 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fab2a-49f3-48de-b393-e932d1a69b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:56.691725 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fab2a-49f3-48de-b393-e932d1a69b9a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.692212 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fab2a-49f3-48de-b393-e932d1a69b9a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.692684 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fab2a-49f3-48de-b393-e932d1a69b9a None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.692811 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ab11b-3e16-4c3a-9733-7e0b4ec2a5bf None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:56.693978 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fab2a-49f3-48de-b393-e932d1a69b9a None admin] RBAC: Adding query filter params (name=network) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:56.694556 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fab2a-49f3-48de-b393-e932d1a69b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:56.696624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fab2a-49f3-48de-b393-e932d1a69b9a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:56.702425 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 355/705] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Aug 18 21:01:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:56.711420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fab2a-49f3-48de-b393-e932d1a69b9a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:56.729728 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aa08c-477b-4a95-b7d9-4fecc3f293de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:56.730360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aa08c-477b-4a95-b7d9-4fecc3f293de None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.730645 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aa08c-477b-4a95-b7d9-4fecc3f293de None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.730922 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aa08c-477b-4a95-b7d9-4fecc3f293de None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.731595 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3aa08c-477b-4a95-b7d9-4fecc3f293de None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:56.731890 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3aa08c-477b-4a95-b7d9-4fecc3f293de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:56.733266 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3aa08c-477b-4a95-b7d9-4fecc3f293de None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:56.739226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 351/706] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Aug 18 21:01:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:56.748918 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aa08c-477b-4a95-b7d9-4fecc3f293de None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:56.767186 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:56.806310 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:56.847473 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fab2a-49f3-48de-b393-e932d1a69b9a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:56.870551 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aa08c-477b-4a95-b7d9-4fecc3f293de None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:56.892006 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7ecd3-0730-4431-8ba5-6aafe916cb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:56.893927 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7ecd3-0730-4431-8ba5-6aafe916cb5e None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.894728 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7ecd3-0730-4431-8ba5-6aafe916cb5e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.895226 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7ecd3-0730-4431-8ba5-6aafe916cb5e None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.896237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7ecd3-0730-4431-8ba5-6aafe916cb5e None admin] RBAC: Adding query filter params (type=network) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:56.897018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7ecd3-0730-4431-8ba5-6aafe916cb5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:56.898999 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7ecd3-0730-4431-8ba5-6aafe916cb5e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:56.906021 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 356/707] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Aug 18 21:01:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:56.911730 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7ecd3-0730-4431-8ba5-6aafe916cb5e None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:56.912772 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fea5c3-042a-49e5-a226-2c53592f8014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:56.913475 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fea5c3-042a-49e5-a226-2c53592f8014 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.913874 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fea5c3-042a-49e5-a226-2c53592f8014 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.914217 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fea5c3-042a-49e5-a226-2c53592f8014 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.915000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fea5c3-042a-49e5-a226-2c53592f8014 None admin] RBAC: Adding query filter params (interface=public, service_id=ef51dc1f8f374653bff29440db392ac2, region_id=RegionOne) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:56.915694 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fea5c3-042a-49e5-a226-2c53592f8014 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:56.917487 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fea5c3-042a-49e5-a226-2c53592f8014 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:56.927552 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 352/708] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Aug 18 21:01:56 2022] GET /identity/v3/endpoints?service_id=ef51dc1f8f374653bff29440db392ac2&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:56.928608 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fea5c3-042a-49e5-a226-2c53592f8014 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:57.019729 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:57.043876 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7ecd3-0730-4431-8ba5-6aafe916cb5e None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:57.045254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fea5c3-042a-49e5-a226-2c53592f8014 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:57.091660 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc25f6-7729-4493-815f-1d6803ec1135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:57.092822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc25f6-7729-4493-815f-1d6803ec1135 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:57.093135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07cba1-43f2-443d-b6cd-cdce7b26a4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:57.093496 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc25f6-7729-4493-815f-1d6803ec1135 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:57.093921 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07cba1-43f2-443d-b6cd-cdce7b26a4b6 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:57.094141 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc25f6-7729-4493-815f-1d6803ec1135 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:57.094285 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07cba1-43f2-443d-b6cd-cdce7b26a4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:57.094658 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07cba1-43f2-443d-b6cd-cdce7b26a4b6 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:57.095350 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc25f6-7729-4493-815f-1d6803ec1135 None admin] RBAC: Adding query filter params (interface=public, service_id=295d408f6c1f4d6c9f2f98055ac69e89, region_id=RegionOne) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:57.095456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07cba1-43f2-443d-b6cd-cdce7b26a4b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:57.096518 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc25f6-7729-4493-815f-1d6803ec1135 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:57.097634 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07cba1-43f2-443d-b6cd-cdce7b26a4b6 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:57.098317 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc25f6-7729-4493-815f-1d6803ec1135 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:57.107916 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 353/709] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Aug 18 21:01:56 2022] GET /identity/v3/services => generated 1002 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:01:57.108480 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:57.114018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 357/710] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Aug 18 21:01:56 2022] GET /identity/v3/endpoints?service_id=295d408f6c1f4d6c9f2f98055ac69e89&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:57.122656 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07cba1-43f2-443d-b6cd-cdce7b26a4b6 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:57.203325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575faaf-2ae5-4170-9f99-879d1dd43fc7 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:57.203704 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575faaf-2ae5-4170-9f99-879d1dd43fc7 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:57.204057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575faaf-2ae5-4170-9f99-879d1dd43fc7 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:57.206379 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 358/711] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:57.213588 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210611b-ae40-4a23-aca8-3d0c49806142 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:57.214017 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210611b-ae40-4a23-aca8-3d0c49806142 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:57.214394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210611b-ae40-4a23-aca8-3d0c49806142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:57.240090 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07cba1-43f2-443d-b6cd-cdce7b26a4b6 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:57.241024 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-d210611b-ae40-4a23-aca8-3d0c49806142 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:57.242657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-d210611b-ae40-4a23-aca8-3d0c49806142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:57.279682 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdda46-55e5-48e5-a080-47799264fb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:57.280655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdda46-55e5-48e5-a080-47799264fb9d None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:57.281200 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdda46-55e5-48e5-a080-47799264fb9d None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:57.281664 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdda46-55e5-48e5-a080-47799264fb9d None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:57.282539 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdda46-55e5-48e5-a080-47799264fb9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:57.284727 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdda46-55e5-48e5-a080-47799264fb9d None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:57.291900 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 354/712] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Aug 18 21:01:57 2022] GET /identity/v3/services => generated 1002 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:01:57.336464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 359/713] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:57 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:01:57.666018 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdda46-55e5-48e5-a080-47799264fb9d None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:57.669966 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:57.773214 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdda46-55e5-48e5-a080-47799264fb9d None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:57.809898 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91baa-76ca-4c57-82b3-74e878f183f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:57.810861 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91baa-76ca-4c57-82b3-74e878f183f1 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:57.811458 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91baa-76ca-4c57-82b3-74e878f183f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:57.811921 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91baa-76ca-4c57-82b3-74e878f183f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:57.823912 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e91baa-76ca-4c57-82b3-74e878f183f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-c3e91baa-76ca-4c57-82b3-74e878f183f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:01:57.829355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:57.830356 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:57.831334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:57.831334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:57.831334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:57.831334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:57.831334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:01:57.831334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:01:57.831334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:01:57.831334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:01:57.831334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:01:57.831334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:01:57.831334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:01:57.831334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:57.833933 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 355/714] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:01:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:57.839959 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210611b-ae40-4a23-aca8-3d0c49806142 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:57.944802 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210611b-ae40-4a23-aca8-3d0c49806142 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:57.974503 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:57.981626 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48ff6d-5258-40d9-abf5-18dd61763d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:57.982559 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48ff6d-5258-40d9-abf5-18dd61763d5a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:57.983075 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48ff6d-5258-40d9-abf5-18dd61763d5a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:57.983614 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48ff6d-5258-40d9-abf5-18dd61763d5a None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:57.984481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48ff6d-5258-40d9-abf5-18dd61763d5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:57.984986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48ff6d-5258-40d9-abf5-18dd61763d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:57.987137 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48ff6d-5258-40d9-abf5-18dd61763d5a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:57.996221 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 360/715] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:01:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:58.002682 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91baa-76ca-4c57-82b3-74e878f183f1 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:58.068991 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:58.110371 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91baa-76ca-4c57-82b3-74e878f183f1 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:58.147217 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a79281-fafc-4c0c-af36-2bb24ae93ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:58.148280 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a79281-fafc-4c0c-af36-2bb24ae93ea3 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:58.148841 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a79281-fafc-4c0c-af36-2bb24ae93ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:58.149314 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a79281-fafc-4c0c-af36-2bb24ae93ea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:58.160729 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a79281-fafc-4c0c-af36-2bb24ae93ea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:58.162578 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a79281-fafc-4c0c-af36-2bb24ae93ea3 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-43a79281-fafc-4c0c-af36-2bb24ae93ea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:58.178146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:58.179199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:58.180168 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:58.180168 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:58.180168 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:58.182210 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 356/716] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:58.188045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48ff6d-5258-40d9-abf5-18dd61763d5a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:58.297484 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48ff6d-5258-40d9-abf5-18dd61763d5a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:58.335596 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca243f1-8c5d-4ecd-ab1b-53ef12ee7644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:58.336656 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca243f1-8c5d-4ecd-ab1b-53ef12ee7644 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:58.337147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca243f1-8c5d-4ecd-ab1b-53ef12ee7644 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:58.337667 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca243f1-8c5d-4ecd-ab1b-53ef12ee7644 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:58.338577 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca243f1-8c5d-4ecd-ab1b-53ef12ee7644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:58.339277 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca243f1-8c5d-4ecd-ab1b-53ef12ee7644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:58.340923 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca243f1-8c5d-4ecd-ab1b-53ef12ee7644 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:58.354159 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 361/717] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:58.360063 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a79281-fafc-4c0c-af36-2bb24ae93ea3 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:58.472181 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a79281-fafc-4c0c-af36-2bb24ae93ea3 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:58.491923 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:58.512707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7b5b8-5db9-4db6-b81f-b8f50189060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:58.513733 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7b5b8-5db9-4db6-b81f-b8f50189060e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:58.514222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7b5b8-5db9-4db6-b81f-b8f50189060e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:58.514700 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7b5b8-5db9-4db6-b81f-b8f50189060e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:58.523317 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7b5b8-5db9-4db6-b81f-b8f50189060e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:58.524992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7b5b8-5db9-4db6-b81f-b8f50189060e None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-6bf7b5b8-5db9-4db6-b81f-b8f50189060e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:01:58.537038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:58.537992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:58.538943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:58.538943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:58.538943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:01:58.538943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:01:58.538943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:01:58.538943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:01:58.538943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:01:58.538943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:01:58.538943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:01:58.538943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:58.541536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 357/718] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Aug 18 21:01:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:58.547614 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca243f1-8c5d-4ecd-ab1b-53ef12ee7644 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:58.611306 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:58.638816 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0419a0e-4601-48db-ae0e-a77039304004 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:58.639127 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0419a0e-4601-48db-ae0e-a77039304004 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:58.639404 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0419a0e-4601-48db-ae0e-a77039304004 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:58.641846 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 358/719] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:58.649576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae085-9fb5-458f-a437-98adb9d3b558 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:58.649856 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae085-9fb5-458f-a437-98adb9d3b558 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:58.650131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae085-9fb5-458f-a437-98adb9d3b558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:58.668903 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca243f1-8c5d-4ecd-ab1b-53ef12ee7644 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:58.669757 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-009ae085-9fb5-458f-a437-98adb9d3b558 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:58.670924 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-009ae085-9fb5-458f-a437-98adb9d3b558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:58.712795 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13dc0e-8e28-4d59-9986-2271157b43d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:58.713406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13dc0e-8e28-4d59-9986-2271157b43d6 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:58.713690 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13dc0e-8e28-4d59-9986-2271157b43d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:58.713966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13dc0e-8e28-4d59-9986-2271157b43d6 None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:58.715061 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13dc0e-8e28-4d59-9986-2271157b43d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:58.715401 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13dc0e-8e28-4d59-9986-2271157b43d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:58.717465 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13dc0e-8e28-4d59-9986-2271157b43d6 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:58.740929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 362/720] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Aug 18 21:01:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:58.745455 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 359/721] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:01:58.746338 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13dc0e-8e28-4d59-9986-2271157b43d6 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:58.848504 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13dc0e-8e28-4d59-9986-2271157b43d6 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:58.859666 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:58.885595 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ce994-a040-4224-a4c2-7858d5a41fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:58.886205 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ce994-a040-4224-a4c2-7858d5a41fb3 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:58.886485 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ce994-a040-4224-a4c2-7858d5a41fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:58.886761 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ce994-a040-4224-a4c2-7858d5a41fb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:58.956947 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ce994-a040-4224-a4c2-7858d5a41fb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:58.958417 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ce994-a040-4224-a4c2-7858d5a41fb3 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:59.060822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 363/722] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:01:58 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 21:01:59.066852 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ae085-9fb5-458f-a437-98adb9d3b558 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:59.099419 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ce994-a040-4224-a4c2-7858d5a41fb3 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:59.112771 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:59.188632 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ae085-9fb5-458f-a437-98adb9d3b558 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:59.207714 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:59.221673 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ce994-a040-4224-a4c2-7858d5a41fb3 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:59.224983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de56bfa-3e4a-4bca-990a-8d8428fc71fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:59.225680 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de56bfa-3e4a-4bca-990a-8d8428fc71fa None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.225961 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de56bfa-3e4a-4bca-990a-8d8428fc71fa None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.226357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de56bfa-3e4a-4bca-990a-8d8428fc71fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.238215 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de56bfa-3e4a-4bca-990a-8d8428fc71fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:59.240082 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de56bfa-3e4a-4bca-990a-8d8428fc71fa None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-6de56bfa-3e4a-4bca-990a-8d8428fc71fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:01:59.257250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:59.259203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:01:59.260713 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:01:59.260713 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:01:59.260713 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:59.260713 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 360/723] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:59.265407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de56bfa-3e4a-4bca-990a-8d8428fc71fa None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:59.269511 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5e12d-f901-4f78-9201-95b01be325bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:59.271048 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5e12d-f901-4f78-9201-95b01be325bd None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.271392 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5e12d-f901-4f78-9201-95b01be325bd None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.271676 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5e12d-f901-4f78-9201-95b01be325bd None admin] PATH_INFO: `/v3/services/image` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.272282 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5e12d-f901-4f78-9201-95b01be325bd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:59.273665 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5e12d-f901-4f78-9201-95b01be325bd None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-99b5e12d-f901-4f78-9201-95b01be325bd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:59.285214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:59.286441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:01:59.287348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 364/724] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Aug 18 21:01:59 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:01:59.293175 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5e12d-f901-4f78-9201-95b01be325bd None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:59.379947 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:59.393951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de56bfa-3e4a-4bca-990a-8d8428fc71fa None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:59.412189 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5e12d-f901-4f78-9201-95b01be325bd None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:59.432430 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e9250-e924-4e85-8dcc-fe507b4ecb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:59.433043 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e9250-e924-4e85-8dcc-fe507b4ecb61 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.433357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e9250-e924-4e85-8dcc-fe507b4ecb61 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.433631 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e9250-e924-4e85-8dcc-fe507b4ecb61 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.434286 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e9250-e924-4e85-8dcc-fe507b4ecb61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:59.434592 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e9250-e924-4e85-8dcc-fe507b4ecb61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:59.436041 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e9250-e924-4e85-8dcc-fe507b4ecb61 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:59.449830 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 361/725] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:59.451988 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608785e8-9a19-4616-90d1-d57d04325fc0 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.452558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608785e8-9a19-4616-90d1-d57d04325fc0 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.452893 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07927416-0079-4326-ad92-ed7c518cbee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:59.453283 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608785e8-9a19-4616-90d1-d57d04325fc0 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.453563 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07927416-0079-4326-ad92-ed7c518cbee0 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.453846 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07927416-0079-4326-ad92-ed7c518cbee0 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.454122 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07927416-0079-4326-ad92-ed7c518cbee0 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.454801 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07927416-0079-4326-ad92-ed7c518cbee0 None admin] RBAC: Adding query filter params (name=image) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:59.455137 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07927416-0079-4326-ad92-ed7c518cbee0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:59.455570 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 362/726] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:59.456197 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608785e8-9a19-4616-90d1-d57d04325fc0 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:59.461583 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07927416-0079-4326-ad92-ed7c518cbee0 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:59.466986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 365/727] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:59.468076 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f7bd8-2f9d-47fb-948c-b25e232d2671 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.468363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f7bd8-2f9d-47fb-948c-b25e232d2671 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.468638 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f7bd8-2f9d-47fb-948c-b25e232d2671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.480877 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:59.489278 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-bc4f7bd8-2f9d-47fb-948c-b25e232d2671 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:59.490462 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-bc4f7bd8-2f9d-47fb-948c-b25e232d2671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:59.562859 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 366/728] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:59 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:01:59.564007 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f7bd8-2f9d-47fb-948c-b25e232d2671 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:59.582376 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608785e8-9a19-4616-90d1-d57d04325fc0 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:59.620257 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a325a-8136-4197-a9b2-8c3076688b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:59.621003 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a325a-8136-4197-a9b2-8c3076688b1b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.621282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a325a-8136-4197-a9b2-8c3076688b1b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.621583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a325a-8136-4197-a9b2-8c3076688b1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.629149 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a325a-8136-4197-a9b2-8c3076688b1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:59.630627 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a325a-8136-4197-a9b2-8c3076688b1b None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:59.640485 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-362a325a-8136-4197-a9b2-8c3076688b1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:01:59.641893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:01:59.643112 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:01:59.649423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:01:59.649423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:01:59.649423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:01:59.649423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:01:59.649423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:01:59.649423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:01:59.649423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:01:59.649423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:01:59.649423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 363/729] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:01:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:01:59.649423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e402b4-7762-411a-9fd5-5c188835c4cf None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.649423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e402b4-7762-411a-9fd5-5c188835c4cf None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.650432 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e402b4-7762-411a-9fd5-5c188835c4cf None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.650432 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 364/730] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:59.650432 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e402b4-7762-411a-9fd5-5c188835c4cf None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:59.685321 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f7bd8-2f9d-47fb-948c-b25e232d2671 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:59.722826 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afc22c-2d45-4e8c-b3fc-b4e95d9dd80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:59.723802 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc22c-2d45-4e8c-b3fc-b4e95d9dd80a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.724291 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc22c-2d45-4e8c-b3fc-b4e95d9dd80a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.724761 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc22c-2d45-4e8c-b3fc-b4e95d9dd80a None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.725578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afc22c-2d45-4e8c-b3fc-b4e95d9dd80a None admin] RBAC: Adding query filter params (type=image) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:59.726092 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afc22c-2d45-4e8c-b3fc-b4e95d9dd80a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:59.727602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afc22c-2d45-4e8c-b3fc-b4e95d9dd80a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:59.730103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:59.733059 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 367/731] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:01:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:59.734316 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb885074-31fd-49f9-9c65-fafc0be3a1e5 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.734602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb885074-31fd-49f9-9c65-fafc0be3a1e5 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.734876 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb885074-31fd-49f9-9c65-fafc0be3a1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.753219 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-cb885074-31fd-49f9-9c65-fafc0be3a1e5 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:59.754390 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-cb885074-31fd-49f9-9c65-fafc0be3a1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:59.761648 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e402b4-7762-411a-9fd5-5c188835c4cf None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:59.799686 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3eb0b-0245-4828-9e23-706a24ea2d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:59.800632 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3eb0b-0245-4828-9e23-706a24ea2d4d None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.801108 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3eb0b-0245-4828-9e23-706a24ea2d4d None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.801454 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3eb0b-0245-4828-9e23-706a24ea2d4d None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.802217 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3eb0b-0245-4828-9e23-706a24ea2d4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:59.802528 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3eb0b-0245-4828-9e23-706a24ea2d4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:59.804308 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3eb0b-0245-4828-9e23-706a24ea2d4d None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:59.822324 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 365/732] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:01:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:59.822324 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3eb0b-0245-4828-9e23-706a24ea2d4d None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:59.827300 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 368/733] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:01:59 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:01:59.827300 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb885074-31fd-49f9-9c65-fafc0be3a1e5 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:59.901633 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:59.940091 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3eb0b-0245-4828-9e23-706a24ea2d4d None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:59.944044 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb885074-31fd-49f9-9c65-fafc0be3a1e5 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:59.983843 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee8195-095b-4fca-a0c1-8ed99b7fb26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:59.984458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee8195-095b-4fca-a0c1-8ed99b7fb26c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.984736 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee8195-095b-4fca-a0c1-8ed99b7fb26c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.985006 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee8195-095b-4fca-a0c1-8ed99b7fb26c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.985747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee8195-095b-4fca-a0c1-8ed99b7fb26c None admin] RBAC: Adding query filter params (role.id=49c7d15532d94cafac420a6bcf8574ad, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=ba197525d2af40528f7cbe7de9da9a23) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:59.986063 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee8195-095b-4fca-a0c1-8ed99b7fb26c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:59.988151 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee8195-095b-4fca-a0c1-8ed99b7fb26c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:59.995018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 369/734] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:01:59 2022] GET /identity/v3/role_assignments?user.id=ba197525d2af40528f7cbe7de9da9a23&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=49c7d15532d94cafac420a6bcf8574ad => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:59.995929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee8195-095b-4fca-a0c1-8ed99b7fb26c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:00.112980 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fe090-cf5d-4378-ac76-dfc3eedf2a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:00.114040 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fe090-cf5d-4378-ac76-dfc3eedf2a1a None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:00.114332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fe090-cf5d-4378-ac76-dfc3eedf2a1a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:00.114607 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fe090-cf5d-4378-ac76-dfc3eedf2a1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:00.115637 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fe090-cf5d-4378-ac76-dfc3eedf2a1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:00.117681 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fe090-cf5d-4378-ac76-dfc3eedf2a1a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:00.123670 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee8195-095b-4fca-a0c1-8ed99b7fb26c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:00.131932 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:00.152226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 366/735] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Aug 18 21:01:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:00.167852 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:00.188164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5308c-7bf4-4335-ab10-f83c9aa2f613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:00.188377 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fe090-cf5d-4378-ac76-dfc3eedf2a1a None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:00.188494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5308c-7bf4-4335-ab10-f83c9aa2f613 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:00.188494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5308c-7bf4-4335-ab10-f83c9aa2f613 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:00.188494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5308c-7bf4-4335-ab10-f83c9aa2f613 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:00.189322 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5308c-7bf4-4335-ab10-f83c9aa2f613 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:00.190928 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5308c-7bf4-4335-ab10-f83c9aa2f613 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-79d5308c-7bf4-4335-ab10-f83c9aa2f613 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:00.204116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:00.205251 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:00.206108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 370/736] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Aug 18 21:01:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:00.211675 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5308c-7bf4-4335-ab10-f83c9aa2f613 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:00.328362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fe090-cf5d-4378-ac76-dfc3eedf2a1a None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:00.352864 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5308c-7bf4-4335-ab10-f83c9aa2f613 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:00.377834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba4aad-46f3-45a7-a1d1-da5fe1fb3e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:00.378466 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba4aad-46f3-45a7-a1d1-da5fe1fb3e35 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:00.378747 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba4aad-46f3-45a7-a1d1-da5fe1fb3e35 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:00.379014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba4aad-46f3-45a7-a1d1-da5fe1fb3e35 None admin] PATH_INFO: `/v3/services/network` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:00.379660 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba4aad-46f3-45a7-a1d1-da5fe1fb3e35 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:00.381085 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba4aad-46f3-45a7-a1d1-da5fe1fb3e35 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-40ba4aad-46f3-45a7-a1d1-da5fe1fb3e35 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:00.390296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:00.391332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:02:00.392209 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:00.393525 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 367/737] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:02:00 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:02:00.398363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59505d47-d8d7-459b-b3e5-c190175ab66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:00.398963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59505d47-d8d7-459b-b3e5-c190175ab66e None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:00.399249 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59505d47-d8d7-459b-b3e5-c190175ab66e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:00.399639 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59505d47-d8d7-459b-b3e5-c190175ab66e None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:00.400270 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59505d47-d8d7-459b-b3e5-c190175ab66e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:00.400469 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba4aad-46f3-45a7-a1d1-da5fe1fb3e35 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:00.400652 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59505d47-d8d7-459b-b3e5-c190175ab66e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:00.401932 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59505d47-d8d7-459b-b3e5-c190175ab66e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:00.408957 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 371/738] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Aug 18 21:02:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:02:00.414413 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59505d47-d8d7-459b-b3e5-c190175ab66e None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:00.472930 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:00.473528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:00.519571 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba4aad-46f3-45a7-a1d1-da5fe1fb3e35 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:00.535769 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59505d47-d8d7-459b-b3e5-c190175ab66e None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:00.555662 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4929fa8-3874-464b-a19f-743a692ee856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:00.556416 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4929fa8-3874-464b-a19f-743a692ee856 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:00.556801 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4929fa8-3874-464b-a19f-743a692ee856 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:00.557177 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4929fa8-3874-464b-a19f-743a692ee856 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:00.557931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4929fa8-3874-464b-a19f-743a692ee856 None admin] RBAC: Adding query filter params (name=network) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:00.558338 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4929fa8-3874-464b-a19f-743a692ee856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:00.559862 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4929fa8-3874-464b-a19f-743a692ee856 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:00.570089 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 368/739] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Aug 18 21:02:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:00.571424 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4929fa8-3874-464b-a19f-743a692ee856 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:00.582873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d06ae-a3e8-47bf-97d1-9c1ed5e187c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:00.583521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d06ae-a3e8-47bf-97d1-9c1ed5e187c6 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:00.584335 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d06ae-a3e8-47bf-97d1-9c1ed5e187c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:00.584621 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d06ae-a3e8-47bf-97d1-9c1ed5e187c6 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:00.585261 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d06ae-a3e8-47bf-97d1-9c1ed5e187c6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:00.585563 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d06ae-a3e8-47bf-97d1-9c1ed5e187c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:00.587313 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d06ae-a3e8-47bf-97d1-9c1ed5e187c6 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:00.595353 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 372/740] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Aug 18 21:02:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:02:00.602840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d06ae-a3e8-47bf-97d1-9c1ed5e187c6 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:00.693577 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4929fa8-3874-464b-a19f-743a692ee856 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:00.726829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:00.730909 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d06ae-a3e8-47bf-97d1-9c1ed5e187c6 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:00.731161 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a322-f72f-4e09-b2ba-efeda353ae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:00.731919 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a322-f72f-4e09-b2ba-efeda353ae71 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:00.732489 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a322-f72f-4e09-b2ba-efeda353ae71 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:00.732869 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a322-f72f-4e09-b2ba-efeda353ae71 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:00.733719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141a322-f72f-4e09-b2ba-efeda353ae71 None admin] RBAC: Adding query filter params (type=network) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:00.734891 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141a322-f72f-4e09-b2ba-efeda353ae71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:00.735764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141a322-f72f-4e09-b2ba-efeda353ae71 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:00.746515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 369/741] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Aug 18 21:02:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:00.747642 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a322-f72f-4e09-b2ba-efeda353ae71 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:00.748487 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:00.770096 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674a98f-5810-495e-9a57-0eb08cff063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:00.770707 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674a98f-5810-495e-9a57-0eb08cff063c None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:00.770984 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674a98f-5810-495e-9a57-0eb08cff063c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:00.771256 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674a98f-5810-495e-9a57-0eb08cff063c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:00.771943 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674a98f-5810-495e-9a57-0eb08cff063c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:00.773832 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674a98f-5810-495e-9a57-0eb08cff063c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:00.811353 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 373/742] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Aug 18 21:02:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:00.867070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a322-f72f-4e09-b2ba-efeda353ae71 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:00.914186 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e934c29-772b-4d21-9558-c861dda8fcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:00.915306 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e934c29-772b-4d21-9558-c861dda8fcc3 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:00.915821 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e934c29-772b-4d21-9558-c861dda8fcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:00.916300 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e934c29-772b-4d21-9558-c861dda8fcc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:00.917181 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e934c29-772b-4d21-9558-c861dda8fcc3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:00.918856 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e934c29-772b-4d21-9558-c861dda8fcc3 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:00.942680 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 370/743] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Aug 18 21:02:00 2022] POST /identity/v3/endpoints => generated 337 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:02.326892 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bf145-3e62-4d23-ac91-218b3abcb56b None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:02.327515 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bf145-3e62-4d23-ac91-218b3abcb56b None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:02.327515 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bf145-3e62-4d23-ac91-218b3abcb56b None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:02.328835 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 374/744] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:02:02.335028 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5f059-2984-426b-ab75-8c8030fa77a1 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:02.335722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5f059-2984-426b-ab75-8c8030fa77a1 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:02.335722 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5f059-2984-426b-ab75-8c8030fa77a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:02.354951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-27c5f059-2984-426b-ab75-8c8030fa77a1 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:02.356179 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-27c5f059-2984-426b-ab75-8c8030fa77a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:02.387044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:02.432395 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 371/745] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:02 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:02:02.493783 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db7d63-b0a7-4947-90b5-a812a2e7a674 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:02.494131 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db7d63-b0a7-4947-90b5-a812a2e7a674 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:02.494330 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db7d63-b0a7-4947-90b5-a812a2e7a674 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:02.495824 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 375/746] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:02:02.500729 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205b9ca-3dae-4100-8e08-ade15c8f6d50 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:02.501021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205b9ca-3dae-4100-8e08-ade15c8f6d50 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:02.501298 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205b9ca-3dae-4100-8e08-ade15c8f6d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:02.519568 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-e205b9ca-3dae-4100-8e08-ade15c8f6d50 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:02.520810 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-e205b9ca-3dae-4100-8e08-ade15c8f6d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:02.592812 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 372/747] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:02 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:02:02.756177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db7d63-b0a7-4947-90b5-a812a2e7a674 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:02.856180 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db7d63-b0a7-4947-90b5-a812a2e7a674 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:02.888837 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47f6b5-c721-4fad-835d-f650c76e98af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:02.889447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47f6b5-c721-4fad-835d-f650c76e98af None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:02.889724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47f6b5-c721-4fad-835d-f650c76e98af None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:02.889993 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47f6b5-c721-4fad-835d-f650c76e98af None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:02.890564 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47f6b5-c721-4fad-835d-f650c76e98af None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:02.891944 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47f6b5-c721-4fad-835d-f650c76e98af None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-3a47f6b5-c721-4fad-835d-f650c76e98af None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:02.900986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:02.901920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:02:02.902884 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:02.906802 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 376/748] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Aug 18 21:02:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:02.908701 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205b9ca-3dae-4100-8e08-ade15c8f6d50 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:02.924885 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47f6b5-c721-4fad-835d-f650c76e98af None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:02.962665 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:03.015163 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:03.023470 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205b9ca-3dae-4100-8e08-ade15c8f6d50 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:03.041875 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47f6b5-c721-4fad-835d-f650c76e98af None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:03.060415 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6facea-e7f2-4f15-8f45-c891cbd62856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:03.060809 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6facea-e7f2-4f15-8f45-c891cbd62856 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:03.061084 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6facea-e7f2-4f15-8f45-c891cbd62856 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:03.061347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6facea-e7f2-4f15-8f45-c891cbd62856 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:03.061972 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6facea-e7f2-4f15-8f45-c891cbd62856 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:03.062270 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6facea-e7f2-4f15-8f45-c891cbd62856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:03.063889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6facea-e7f2-4f15-8f45-c891cbd62856 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:03.069004 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 373/749] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Aug 18 21:02:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:03.074716 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6facea-e7f2-4f15-8f45-c891cbd62856 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:03.079690 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fcf88-cfa3-4a6b-af78-093257e4d67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:03.080919 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fcf88-cfa3-4a6b-af78-093257e4d67e None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:03.081208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fcf88-cfa3-4a6b-af78-093257e4d67e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:03.081481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fcf88-cfa3-4a6b-af78-093257e4d67e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:03.149356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fcf88-cfa3-4a6b-af78-093257e4d67e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:03.150723 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fcf88-cfa3-4a6b-af78-093257e4d67e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:03.174882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6facea-e7f2-4f15-8f45-c891cbd62856 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:03.183279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:03.208211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50358b07-14d2-460a-8014-045244e0c458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:03.208800 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50358b07-14d2-460a-8014-045244e0c458 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:03.209073 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50358b07-14d2-460a-8014-045244e0c458 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:03.209462 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50358b07-14d2-460a-8014-045244e0c458 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:03.210077 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50358b07-14d2-460a-8014-045244e0c458 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:03.210374 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50358b07-14d2-460a-8014-045244e0c458 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:03.211755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50358b07-14d2-460a-8014-045244e0c458 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:03.215968 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 374/750] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Aug 18 21:02:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:03.217083 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf631ca7-2805-4614-ad5e-033e5030e784 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:03.217363 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf631ca7-2805-4614-ad5e-033e5030e784 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:03.217650 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf631ca7-2805-4614-ad5e-033e5030e784 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:03.223319 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 375/751] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:02:03.226285 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4701b-f1f3-4314-9cde-c2b8ee4bff56 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:03.226560 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4701b-f1f3-4314-9cde-c2b8ee4bff56 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:03.226824 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4701b-f1f3-4314-9cde-c2b8ee4bff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:03.246756 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-8be4701b-f1f3-4314-9cde-c2b8ee4bff56 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:03.248022 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-8be4701b-f1f3-4314-9cde-c2b8ee4bff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:03.257486 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 377/752] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:02:02 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 21:02:03.262868 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fcf88-cfa3-4a6b-af78-093257e4d67e None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:03.268681 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:03.331312 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 376/753] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:03 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:02:03.378968 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fcf88-cfa3-4a6b-af78-093257e4d67e None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:03.416043 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93986bd7-16f8-4bcd-b14f-896d38e56f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:03.416598 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93986bd7-16f8-4bcd-b14f-896d38e56f17 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:03.416877 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93986bd7-16f8-4bcd-b14f-896d38e56f17 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:03.417150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93986bd7-16f8-4bcd-b14f-896d38e56f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:03.419021 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:03.428658 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93986bd7-16f8-4bcd-b14f-896d38e56f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:03.430104 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93986bd7-16f8-4bcd-b14f-896d38e56f17 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-93986bd7-16f8-4bcd-b14f-896d38e56f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:02:03.445170 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:03.446380 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:02:03.447428 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:02:03.447428 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:02:03.447428 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:03.447428 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 378/754] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:02:03.452333 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4701b-f1f3-4314-9cde-c2b8ee4bff56 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:03.551666 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4701b-f1f3-4314-9cde-c2b8ee4bff56 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:03.590355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202f7c0-d255-44c2-854a-24e8ec8d7838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:03.590962 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f7c0-d255-44c2-854a-24e8ec8d7838 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:03.591326 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f7c0-d255-44c2-854a-24e8ec8d7838 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:03.591604 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f7c0-d255-44c2-854a-24e8ec8d7838 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:03.592275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202f7c0-d255-44c2-854a-24e8ec8d7838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:03.592579 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202f7c0-d255-44c2-854a-24e8ec8d7838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:03.593938 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202f7c0-d255-44c2-854a-24e8ec8d7838 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:03.607823 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 377/755] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:03.661512 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93986bd7-16f8-4bcd-b14f-896d38e56f17 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:03.772612 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93986bd7-16f8-4bcd-b14f-896d38e56f17 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:03.812021 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f91e3a-1c9a-46ec-b986-a93f7fab8e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:03.812996 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f91e3a-1c9a-46ec-b986-a93f7fab8e0d None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:03.813439 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f91e3a-1c9a-46ec-b986-a93f7fab8e0d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:03.813874 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f91e3a-1c9a-46ec-b986-a93f7fab8e0d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:03.814606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f91e3a-1c9a-46ec-b986-a93f7fab8e0d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:03.816204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f91e3a-1c9a-46ec-b986-a93f7fab8e0d None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-e7f91e3a-1c9a-46ec-b986-a93f7fab8e0d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:03.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:03.826543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:02:03.827447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:03.830293 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 379/756] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:02:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:03.835888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202f7c0-d255-44c2-854a-24e8ec8d7838 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:03.851842 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:03.947973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202f7c0-d255-44c2-854a-24e8ec8d7838 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:03.982965 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9457c6-8ad6-49a5-8fc0-9ca52b7da04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:03.983584 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9457c6-8ad6-49a5-8fc0-9ca52b7da04d None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:03.983858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9457c6-8ad6-49a5-8fc0-9ca52b7da04d None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:03.984124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9457c6-8ad6-49a5-8fc0-9ca52b7da04d None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:03.984735 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9457c6-8ad6-49a5-8fc0-9ca52b7da04d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:03.985031 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9457c6-8ad6-49a5-8fc0-9ca52b7da04d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:03.986934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9457c6-8ad6-49a5-8fc0-9ca52b7da04d None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:03.991219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 378/757] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:02:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:03.996797 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f91e3a-1c9a-46ec-b986-a93f7fab8e0d None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:04.045975 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:04.094603 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f91e3a-1c9a-46ec-b986-a93f7fab8e0d None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:04.128201 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387b54f-7b37-42e3-89fc-899e38facb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:04.128795 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387b54f-7b37-42e3-89fc-899e38facb14 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:04.129082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387b54f-7b37-42e3-89fc-899e38facb14 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:04.129354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387b54f-7b37-42e3-89fc-899e38facb14 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:04.129970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387b54f-7b37-42e3-89fc-899e38facb14 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:04.130277 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387b54f-7b37-42e3-89fc-899e38facb14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:04.131677 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387b54f-7b37-42e3-89fc-899e38facb14 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:04.136178 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 380/758] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:02:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:05.421909 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dc215-1fcc-480b-89c5-5373403b211c None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:05.422513 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dc215-1fcc-480b-89c5-5373403b211c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:05.422513 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dc215-1fcc-480b-89c5-5373403b211c None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:05.424388 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 379/759] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:02:05.429434 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c9bd-c91c-456d-b007-befda7e0ed79 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:05.429822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c9bd-c91c-456d-b007-befda7e0ed79 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:05.430098 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c9bd-c91c-456d-b007-befda7e0ed79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:05.448766 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-7666c9bd-c91c-456d-b007-befda7e0ed79 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:05.449935 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-7666c9bd-c91c-456d-b007-befda7e0ed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:05.514393 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 381/760] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:05 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:02:05.849408 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dc215-1fcc-480b-89c5-5373403b211c None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:05.925565 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:05.951482 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dc215-1fcc-480b-89c5-5373403b211c None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:05.984528 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebea104-cf19-416f-9230-ba50e60cae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:05.985125 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebea104-cf19-416f-9230-ba50e60cae3a None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:05.985405 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebea104-cf19-416f-9230-ba50e60cae3a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:05.985749 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebea104-cf19-416f-9230-ba50e60cae3a None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:05.986860 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebea104-cf19-416f-9230-ba50e60cae3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:05.988252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebea104-cf19-416f-9230-ba50e60cae3a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:06.002303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 380/761] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Aug 18 21:02:05 2022] POST /identity/v3/services => generated 269 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:06.293233 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b133364-5382-410a-ba2b-8da8fcca6d1e None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:06.293515 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b133364-5382-410a-ba2b-8da8fcca6d1e None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:06.293788 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b133364-5382-410a-ba2b-8da8fcca6d1e None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:06.295108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 382/762] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:02:06.300803 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e265-4a8b-45b1-9921-68227d5fb191 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:06.301124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e265-4a8b-45b1-9921-68227d5fb191 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:06.301401 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e265-4a8b-45b1-9921-68227d5fb191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:06.319847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-a703e265-4a8b-45b1-9921-68227d5fb191 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:06.321289 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-a703e265-4a8b-45b1-9921-68227d5fb191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:06.393507 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 381/763] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:06 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:02:06.715571 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b133364-5382-410a-ba2b-8da8fcca6d1e None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:06.760817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:06.813346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b133364-5382-410a-ba2b-8da8fcca6d1e None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:06.846394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8fda5-f2be-49f0-a75b-a714aa5c1022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:06.846981 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8fda5-f2be-49f0-a75b-a714aa5c1022 None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:06.847290 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8fda5-f2be-49f0-a75b-a714aa5c1022 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:06.847553 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8fda5-f2be-49f0-a75b-a714aa5c1022 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:06.848184 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8fda5-f2be-49f0-a75b-a714aa5c1022 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:06.849547 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8fda5-f2be-49f0-a75b-a714aa5c1022 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:06.864128 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 383/764] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Aug 18 21:02:06 2022] POST /identity/v3/services => generated 251 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:08.190063 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c05ca9-89e8-4512-9598-0e7609ffb96c None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:08.190596 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c05ca9-89e8-4512-9598-0e7609ffb96c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:08.190596 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c05ca9-89e8-4512-9598-0e7609ffb96c None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:08.191946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 382/765] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:02:08.197519 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2804228-8ca1-4e8b-9955-6ab61b6cb26f None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:08.197960 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2804228-8ca1-4e8b-9955-6ab61b6cb26f None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:08.198076 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2804228-8ca1-4e8b-9955-6ab61b6cb26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:08.215534 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-c2804228-8ca1-4e8b-9955-6ab61b6cb26f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:08.216721 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-c2804228-8ca1-4e8b-9955-6ab61b6cb26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:08.286118 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 384/766] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:08 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:02:08.613188 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c05ca9-89e8-4512-9598-0e7609ffb96c None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:08.680216 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:08.722357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c05ca9-89e8-4512-9598-0e7609ffb96c None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:08.755530 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7368781-ce71-4c1e-891d-f21d3adc3e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:08.756143 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7368781-ce71-4c1e-891d-f21d3adc3e82 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:08.756421 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7368781-ce71-4c1e-891d-f21d3adc3e82 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:08.756691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7368781-ce71-4c1e-891d-f21d3adc3e82 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:08.757260 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7368781-ce71-4c1e-891d-f21d3adc3e82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:08.758606 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7368781-ce71-4c1e-891d-f21d3adc3e82 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-c7368781-ce71-4c1e-891d-f21d3adc3e82 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:08.767737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:08.771420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:08.772623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 383/767] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Aug 18 21:02:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:08.774781 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2804228-8ca1-4e8b-9955-6ab61b6cb26f None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:08.803644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:08.873634 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2804228-8ca1-4e8b-9955-6ab61b6cb26f None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:08.911960 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe552c-3641-4c6c-9786-591196c8f0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:08.912564 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe552c-3641-4c6c-9786-591196c8f0a7 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:08.912845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe552c-3641-4c6c-9786-591196c8f0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:08.913117 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe552c-3641-4c6c-9786-591196c8f0a7 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:08.913750 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe552c-3641-4c6c-9786-591196c8f0a7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:08.914051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe552c-3641-4c6c-9786-591196c8f0a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:08.915660 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe552c-3641-4c6c-9786-591196c8f0a7 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:08.921795 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 385/768] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Aug 18 21:02:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:08.927741 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7368781-ce71-4c1e-891d-f21d3adc3e82 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:09.031421 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7368781-ce71-4c1e-891d-f21d3adc3e82 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:09.044955 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8f46-f078-42db-9099-b28307deabcc None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:09.045243 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8f46-f078-42db-9099-b28307deabcc None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:09.045514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8f46-f078-42db-9099-b28307deabcc None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:09.046832 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 386/769] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:02:09.052262 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2c444-308e-4fb8-b366-3c79a7416152 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:09.052550 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2c444-308e-4fb8-b366-3c79a7416152 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:09.052823 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2c444-308e-4fb8-b366-3c79a7416152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:09.058137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:09.067502 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da4153-b0f7-4d66-8a61-80b94f6c3e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:09.068097 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da4153-b0f7-4d66-8a61-80b94f6c3e29 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:09.068374 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da4153-b0f7-4d66-8a61-80b94f6c3e29 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:09.068643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da4153-b0f7-4d66-8a61-80b94f6c3e29 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:09.069260 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da4153-b0f7-4d66-8a61-80b94f6c3e29 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:09.069562 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da4153-b0f7-4d66-8a61-80b94f6c3e29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:09.070833 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-19b2c444-308e-4fb8-b366-3c79a7416152 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:09.071169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da4153-b0f7-4d66-8a61-80b94f6c3e29 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:09.072043 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-19b2c444-308e-4fb8-b366-3c79a7416152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:09.075926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 384/770] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Aug 18 21:02:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:09.081776 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da4153-b0f7-4d66-8a61-80b94f6c3e29 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:09.139239 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 387/771] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:09 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:02:09.185198 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da4153-b0f7-4d66-8a61-80b94f6c3e29 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:09.217583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa84f0-290c-4c7b-9e60-f3da97441944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:09.218168 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa84f0-290c-4c7b-9e60-f3da97441944 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:09.218443 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa84f0-290c-4c7b-9e60-f3da97441944 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:09.218710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa84f0-290c-4c7b-9e60-f3da97441944 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:09.219459 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa84f0-290c-4c7b-9e60-f3da97441944 None admin] RBAC: Adding query filter params (interface=public, service_id=0087fe5b121c4f74aa4587a00795883c, region_id=RegionOne) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:09.220342 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa84f0-290c-4c7b-9e60-f3da97441944 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:09.221714 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa84f0-290c-4c7b-9e60-f3da97441944 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:09.226518 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 385/772] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Aug 18 21:02:09 2022] GET /identity/v3/endpoints?service_id=0087fe5b121c4f74aa4587a00795883c&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:02:09.232215 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2c444-308e-4fb8-b366-3c79a7416152 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:09.255941 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:09.329204 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2c444-308e-4fb8-b366-3c79a7416152 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:09.361564 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905e1e6-24fc-441d-b93d-309a99eb9748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:09.362177 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905e1e6-24fc-441d-b93d-309a99eb9748 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:09.362459 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905e1e6-24fc-441d-b93d-309a99eb9748 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:09.362727 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905e1e6-24fc-441d-b93d-309a99eb9748 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:09.363342 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905e1e6-24fc-441d-b93d-309a99eb9748 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:09.364699 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905e1e6-24fc-441d-b93d-309a99eb9748 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:09.370409 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 388/773] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Aug 18 21:02:09 2022] GET /identity/v3/services => generated 1498 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:02:09.462033 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa84f0-290c-4c7b-9e60-f3da97441944 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:09.520537 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:09.567669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa84f0-290c-4c7b-9e60-f3da97441944 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:09.606391 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f094aa7-b3db-42bf-8d05-d6fa66b210e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:09.607020 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f094aa7-b3db-42bf-8d05-d6fa66b210e9 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:09.607326 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f094aa7-b3db-42bf-8d05-d6fa66b210e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:09.607601 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f094aa7-b3db-42bf-8d05-d6fa66b210e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:09.608178 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f094aa7-b3db-42bf-8d05-d6fa66b210e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:09.609533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f094aa7-b3db-42bf-8d05-d6fa66b210e9 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-7f094aa7-b3db-42bf-8d05-d6fa66b210e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:09.618072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:09.619048 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:09.620471 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 386/774] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:02:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:09.625070 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905e1e6-24fc-441d-b93d-309a99eb9748 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:09.711841 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:09.724500 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905e1e6-24fc-441d-b93d-309a99eb9748 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:09.757888 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aaffa-fef0-40a1-93fb-66106b62b210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:09.758482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aaffa-fef0-40a1-93fb-66106b62b210 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:09.758765 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aaffa-fef0-40a1-93fb-66106b62b210 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:09.759039 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aaffa-fef0-40a1-93fb-66106b62b210 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:09.759689 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561aaffa-fef0-40a1-93fb-66106b62b210 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:09.759996 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561aaffa-fef0-40a1-93fb-66106b62b210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:09.761354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561aaffa-fef0-40a1-93fb-66106b62b210 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:09.765898 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 389/775] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:02:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:02:09.772342 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f094aa7-b3db-42bf-8d05-d6fa66b210e9 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:09.869064 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f094aa7-b3db-42bf-8d05-d6fa66b210e9 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:09.885631 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:09.902918 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed18b2-06f8-46f9-83f6-a6140bc05959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:09.903544 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed18b2-06f8-46f9-83f6-a6140bc05959 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:09.903823 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed18b2-06f8-46f9-83f6-a6140bc05959 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:09.904093 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed18b2-06f8-46f9-83f6-a6140bc05959 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:09.904709 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed18b2-06f8-46f9-83f6-a6140bc05959 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:09.905007 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed18b2-06f8-46f9-83f6-a6140bc05959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:09.906526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed18b2-06f8-46f9-83f6-a6140bc05959 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:09.911201 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 387/776] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:02:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:09.917437 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aaffa-fef0-40a1-93fb-66106b62b210 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:10.019346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aaffa-fef0-40a1-93fb-66106b62b210 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:10.052881 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d45366-5bf9-4364-bb42-9e74a56111b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:10.053479 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d45366-5bf9-4364-bb42-9e74a56111b4 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:10.053762 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d45366-5bf9-4364-bb42-9e74a56111b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:10.054035 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d45366-5bf9-4364-bb42-9e74a56111b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:10.054724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d45366-5bf9-4364-bb42-9e74a56111b4 None admin] RBAC: Adding query filter params (interface=public, service_id=8f7931db423543568159acd27384d255, region_id=RegionOne) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:10.055035 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d45366-5bf9-4364-bb42-9e74a56111b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:10.056442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d45366-5bf9-4364-bb42-9e74a56111b4 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:10.061318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 390/777] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Aug 18 21:02:09 2022] GET /identity/v3/endpoints?service_id=8f7931db423543568159acd27384d255&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:10.066999 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed18b2-06f8-46f9-83f6-a6140bc05959 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:10.164176 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed18b2-06f8-46f9-83f6-a6140bc05959 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:10.197004 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57c3e2-d4ee-45b5-b4a9-68ea99189b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:10.197610 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57c3e2-d4ee-45b5-b4a9-68ea99189b7b None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:10.197888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57c3e2-d4ee-45b5-b4a9-68ea99189b7b None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:10.198158 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57c3e2-d4ee-45b5-b4a9-68ea99189b7b None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:10.198745 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57c3e2-d4ee-45b5-b4a9-68ea99189b7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:10.200124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57c3e2-d4ee-45b5-b4a9-68ea99189b7b None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:10.205897 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 388/778] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Aug 18 21:02:10 2022] GET /identity/v3/services => generated 1498 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:02:11.554437 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009d0c7-420f-42c3-8b01-4974468f32ba None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:11.555006 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009d0c7-420f-42c3-8b01-4974468f32ba None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:11.555006 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009d0c7-420f-42c3-8b01-4974468f32ba None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:11.556340 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 391/779] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:02:11.561568 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a72b67-9c05-4c84-bde0-7c4b8908c36c None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:11.561942 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a72b67-9c05-4c84-bde0-7c4b8908c36c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:11.562109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a72b67-9c05-4c84-bde0-7c4b8908c36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:11.580815 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-05a72b67-9c05-4c84-bde0-7c4b8908c36c None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:11.581994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-05a72b67-9c05-4c84-bde0-7c4b8908c36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:11.623315 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:11.648046 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 389/780] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:11 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:02:11.982040 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009d0c7-420f-42c3-8b01-4974468f32ba None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:12.002176 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:12.084944 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009d0c7-420f-42c3-8b01-4974468f32ba None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:12.118551 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee25ce-5168-4a41-b386-a20732a8d602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:12.119168 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee25ce-5168-4a41-b386-a20732a8d602 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:12.119480 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee25ce-5168-4a41-b386-a20732a8d602 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:12.119754 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee25ce-5168-4a41-b386-a20732a8d602 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:12.120325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee25ce-5168-4a41-b386-a20732a8d602 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:12.121691 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee25ce-5168-4a41-b386-a20732a8d602 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-1dee25ce-5168-4a41-b386-a20732a8d602 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:12.130222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:12.131163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:12.132208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 392/781] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Aug 18 21:02:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:12.137193 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a72b67-9c05-4c84-bde0-7c4b8908c36c None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:12.236816 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a72b67-9c05-4c84-bde0-7c4b8908c36c None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:12.272249 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37f140-fe99-4085-8c55-b83d31932ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:12.272858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37f140-fe99-4085-8c55-b83d31932ba0 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:12.273140 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37f140-fe99-4085-8c55-b83d31932ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:12.273412 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37f140-fe99-4085-8c55-b83d31932ba0 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:12.274034 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37f140-fe99-4085-8c55-b83d31932ba0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:12.274335 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37f140-fe99-4085-8c55-b83d31932ba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:12.275751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37f140-fe99-4085-8c55-b83d31932ba0 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:12.280437 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 390/782] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Aug 18 21:02:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:12.286467 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee25ce-5168-4a41-b386-a20732a8d602 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:12.365751 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:12.384736 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee25ce-5168-4a41-b386-a20732a8d602 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:12.393326 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5737e7-22c3-4fd2-a4dc-aa29139255bf None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:12.393614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5737e7-22c3-4fd2-a4dc-aa29139255bf None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:12.393887 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5737e7-22c3-4fd2-a4dc-aa29139255bf None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:12.395201 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 391/783] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:02:12.400106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4f96f-54ee-4ffa-965c-8fad57a3a7a4 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:12.400385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4f96f-54ee-4ffa-965c-8fad57a3a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:12.400655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4f96f-54ee-4ffa-965c-8fad57a3a7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:12.418429 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-49b4f96f-54ee-4ffa-965c-8fad57a3a7a4 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:12.419635 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-49b4f96f-54ee-4ffa-965c-8fad57a3a7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:12.422027 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e567068-a860-4869-97e3-8f7cdbda1784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:12.423148 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e567068-a860-4869-97e3-8f7cdbda1784 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:12.423470 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e567068-a860-4869-97e3-8f7cdbda1784 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:12.423746 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e567068-a860-4869-97e3-8f7cdbda1784 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:12.424366 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e567068-a860-4869-97e3-8f7cdbda1784 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:12.424674 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e567068-a860-4869-97e3-8f7cdbda1784 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:12.426034 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e567068-a860-4869-97e3-8f7cdbda1784 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:12.430747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 393/784] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Aug 18 21:02:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:12.436750 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e567068-a860-4869-97e3-8f7cdbda1784 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:12.453562 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:12.486026 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 392/785] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:12 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:02:12.534076 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e567068-a860-4869-97e3-8f7cdbda1784 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:12.566376 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1399bb8-2f5a-4d3f-8a2b-b14201ef6fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:12.566991 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1399bb8-2f5a-4d3f-8a2b-b14201ef6fc8 None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:12.567236 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1399bb8-2f5a-4d3f-8a2b-b14201ef6fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:12.567538 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1399bb8-2f5a-4d3f-8a2b-b14201ef6fc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:12.568185 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1399bb8-2f5a-4d3f-8a2b-b14201ef6fc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:12.569537 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1399bb8-2f5a-4d3f-8a2b-b14201ef6fc8 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:12.584185 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:12.590560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 394/786] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Aug 18 21:02:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:02:12.812514 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4f96f-54ee-4ffa-965c-8fad57a3a7a4 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:12.908111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4f96f-54ee-4ffa-965c-8fad57a3a7a4 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:12.947305 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44bdbd-6fe3-4195-a80e-8f00ae8156bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:12.947962 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44bdbd-6fe3-4195-a80e-8f00ae8156bc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:12.948243 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44bdbd-6fe3-4195-a80e-8f00ae8156bc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:12.948509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44bdbd-6fe3-4195-a80e-8f00ae8156bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:12.949075 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44bdbd-6fe3-4195-a80e-8f00ae8156bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:12.950425 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44bdbd-6fe3-4195-a80e-8f00ae8156bc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-cb44bdbd-6fe3-4195-a80e-8f00ae8156bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:12.958848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:12.959951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:12.960829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 393/787] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:02:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:12.965745 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1399bb8-2f5a-4d3f-8a2b-b14201ef6fc8 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:13.067149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1399bb8-2f5a-4d3f-8a2b-b14201ef6fc8 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:13.100288 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14c547-3e0a-4420-8509-093958888bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:13.100885 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14c547-3e0a-4420-8509-093958888bea None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:13.101160 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14c547-3e0a-4420-8509-093958888bea None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:13.101435 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14c547-3e0a-4420-8509-093958888bea None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:13.102056 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14c547-3e0a-4420-8509-093958888bea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:13.102355 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14c547-3e0a-4420-8509-093958888bea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:13.103761 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14c547-3e0a-4420-8509-093958888bea None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:13.108499 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 395/788] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:02:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:13.114145 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44bdbd-6fe3-4195-a80e-8f00ae8156bc None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:13.144781 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:13.214011 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44bdbd-6fe3-4195-a80e-8f00ae8156bc None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:13.246044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae963356-8990-49d9-96ff-2cf14805aac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:13.246638 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae963356-8990-49d9-96ff-2cf14805aac7 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:13.246915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae963356-8990-49d9-96ff-2cf14805aac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:13.247185 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae963356-8990-49d9-96ff-2cf14805aac7 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:13.247840 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae963356-8990-49d9-96ff-2cf14805aac7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:13.248141 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae963356-8990-49d9-96ff-2cf14805aac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:13.249492 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae963356-8990-49d9-96ff-2cf14805aac7 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:13.254165 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 394/789] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Aug 18 21:02:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:13.260050 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14c547-3e0a-4420-8509-093958888bea None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:13.320747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:13.357727 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14c547-3e0a-4420-8509-093958888bea None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:13.389475 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb2763-bba1-4958-9a9a-f0d232fce83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:13.390063 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb2763-bba1-4958-9a9a-f0d232fce83c None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:13.390362 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb2763-bba1-4958-9a9a-f0d232fce83c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:13.390631 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb2763-bba1-4958-9a9a-f0d232fce83c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:13.391377 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb2763-bba1-4958-9a9a-f0d232fce83c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:13.393220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb2763-bba1-4958-9a9a-f0d232fce83c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:13.412626 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 396/790] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Aug 18 21:02:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:14.801717 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4f92-82ef-4fb6-879c-8cd8fa746b5c None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:14.802232 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4f92-82ef-4fb6-879c-8cd8fa746b5c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:14.802317 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4f92-82ef-4fb6-879c-8cd8fa746b5c None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:14.803619 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 395/791] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:02:14.808720 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5e06a-ee9c-43c8-b345-07f4fc342312 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:14.809125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5e06a-ee9c-43c8-b345-07f4fc342312 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:14.809400 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5e06a-ee9c-43c8-b345-07f4fc342312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:14.827780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-c1d5e06a-ee9c-43c8-b345-07f4fc342312 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:14.829541 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-c1d5e06a-ee9c-43c8-b345-07f4fc342312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:14.898258 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 397/792] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:14 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:02:15.218552 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4f92-82ef-4fb6-879c-8cd8fa746b5c None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:15.310714 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:15.318891 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4f92-82ef-4fb6-879c-8cd8fa746b5c None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:15.352051 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa12c6-d712-410b-8645-1b257b960862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:15.352669 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa12c6-d712-410b-8645-1b257b960862 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:15.352943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa12c6-d712-410b-8645-1b257b960862 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:15.353211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa12c6-d712-410b-8645-1b257b960862 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:15.353772 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa12c6-d712-410b-8645-1b257b960862 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:15.355126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa12c6-d712-410b-8645-1b257b960862 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-23aa12c6-d712-410b-8645-1b257b960862 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:15.363501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:15.364672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:02:15.365794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:15.367579 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 396/793] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:02:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:15.370375 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5e06a-ee9c-43c8-b345-07f4fc342312 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:15.415345 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:15.470837 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5e06a-ee9c-43c8-b345-07f4fc342312 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:15.505782 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa547-054f-416c-b6c7-a90080286347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:15.506384 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa547-054f-416c-b6c7-a90080286347 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:15.506666 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa547-054f-416c-b6c7-a90080286347 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:15.506937 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa547-054f-416c-b6c7-a90080286347 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:15.507591 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa547-054f-416c-b6c7-a90080286347 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:15.507893 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa547-054f-416c-b6c7-a90080286347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:15.509235 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa547-054f-416c-b6c7-a90080286347 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:15.513796 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 398/794] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Aug 18 21:02:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:15.519531 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa12c6-d712-410b-8645-1b257b960862 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:15.615400 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71cf00-cd2d-4c7e-bd35-4e9d561dbca4 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:15.615688 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71cf00-cd2d-4c7e-bd35-4e9d561dbca4 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:15.615963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71cf00-cd2d-4c7e-bd35-4e9d561dbca4 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:15.617414 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 399/795] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:02:15.618895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa12c6-d712-410b-8645-1b257b960862 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:15.622002 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b89f44-ecc4-4322-bb0c-9e798187a636 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:15.622287 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b89f44-ecc4-4322-bb0c-9e798187a636 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:15.622564 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b89f44-ecc4-4322-bb0c-9e798187a636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:15.640584 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-42b89f44-ecc4-4322-bb0c-9e798187a636 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:15.641808 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-42b89f44-ecc4-4322-bb0c-9e798187a636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:15.653136 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38658f0a-1681-4251-ab97-f068827a8f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:15.653738 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38658f0a-1681-4251-ab97-f068827a8f9a None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:15.654017 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38658f0a-1681-4251-ab97-f068827a8f9a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:15.654294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38658f0a-1681-4251-ab97-f068827a8f9a None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:15.655033 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38658f0a-1681-4251-ab97-f068827a8f9a None admin] RBAC: Adding query filter params (type=compute) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:15.655377 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38658f0a-1681-4251-ab97-f068827a8f9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:15.657365 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38658f0a-1681-4251-ab97-f068827a8f9a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:15.661661 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 397/796] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Aug 18 21:02:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:15.720243 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 400/797] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:15 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:02:16.049868 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38658f0a-1681-4251-ab97-f068827a8f9a None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:16.074436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:16.148586 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38658f0a-1681-4251-ab97-f068827a8f9a None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:16.181185 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529acb78-bd86-4b0a-b4ea-13ccf6073fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:16.181772 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529acb78-bd86-4b0a-b4ea-13ccf6073fa7 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:16.182047 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529acb78-bd86-4b0a-b4ea-13ccf6073fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:16.182316 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529acb78-bd86-4b0a-b4ea-13ccf6073fa7 None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:16.182948 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529acb78-bd86-4b0a-b4ea-13ccf6073fa7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:16.184402 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529acb78-bd86-4b0a-b4ea-13ccf6073fa7 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:16.186952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: WARNING keystone.server.flask.common [None req-529acb78-bd86-4b0a-b4ea-13ccf6073fa7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 21:02:16.203429 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.sql.core [None req-529acb78-bd86-4b0a-b4ea-13ccf6073fa7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 21:02:16.203429 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 21:02:16.203429 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [parameters: {'id': '87e9ee84a59f4d4aa9d6fec00cd674a1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 21:02:16.203429 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88582) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 21:02:16.222126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-529acb78-bd86-4b0a-b4ea-13ccf6073fa7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 87e9ee84a59f4d4aa9d6fec00cd674a1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 87e9ee84a59f4d4aa9d6fec00cd674a1. Aug 18 21:02:16.222126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:16.222126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 21:02:16.222126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 21:02:16.222126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 21:02:16.222126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 21:02:16.222126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 21:02:16.222126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 21:02:16.222126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 21:02:16.222126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application conn.query(q) Aug 18 21:02:16.222126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 21:02:16.222126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 21:02:16.222126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application result.read() Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 18 21:02:16.223106 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application next(self.gen) Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application yield resource Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application next(self.gen) Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise self.value Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application session.commit() Aug 18 21:02:16.224115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self.session.flush() Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application compat.raise_( Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 21:02:16.225337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 21:02:16.226646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application conn.query(q) Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application result.read() Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 21:02:16.227731 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [parameters: {'id': '87e9ee84a59f4d4aa9d6fec00cd674a1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:16.228973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:16.229978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:16.231109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:16.231109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 18 21:02:16.231109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 18 21:02:16.231109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:16.231109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:16.231109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 18 21:02:16.231109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 18 21:02:16.231109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 87e9ee84a59f4d4aa9d6fec00cd674a1. Aug 18 21:02:16.231109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:16.231109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 398/798] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Aug 18 21:02:16 2022] POST /identity/v3/projects => generated 262 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:16.231919 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b89f44-ecc4-4322-bb0c-9e798187a636 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:16.270321 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:16.332237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b89f44-ecc4-4322-bb0c-9e798187a636 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:16.364381 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d99946-e8ca-4a2d-8216-81997e6622ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:16.364989 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d99946-e8ca-4a2d-8216-81997e6622ae None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:16.365263 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d99946-e8ca-4a2d-8216-81997e6622ae None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:16.365527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d99946-e8ca-4a2d-8216-81997e6622ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:16.371872 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d99946-e8ca-4a2d-8216-81997e6622ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:16.373297 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d99946-e8ca-4a2d-8216-81997e6622ae None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-04d99946-e8ca-4a2d-8216-81997e6622ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:02:16.385240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:16.386191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:16.387244 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:02:16.387244 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:02:16.387244 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:02:16.387244 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:02:16.387244 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:02:16.387244 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:02:16.387244 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:02:16.387244 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:16.387244 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 401/799] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:02:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:16.392955 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529acb78-bd86-4b0a-b4ea-13ccf6073fa7 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:16.472398 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:16.495501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529acb78-bd86-4b0a-b4ea-13ccf6073fa7 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:16.526974 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31ab43-8dd0-4d58-a790-060e7a72e168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:16.527599 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31ab43-8dd0-4d58-a790-060e7a72e168 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:16.527877 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31ab43-8dd0-4d58-a790-060e7a72e168 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:16.528142 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31ab43-8dd0-4d58-a790-060e7a72e168 None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:16.528791 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31ab43-8dd0-4d58-a790-060e7a72e168 None admin] RBAC: Adding query filter params (name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:16.529087 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31ab43-8dd0-4d58-a790-060e7a72e168 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:16.530690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31ab43-8dd0-4d58-a790-060e7a72e168 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:16.550915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 399/800] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Aug 18 21:02:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:02:17.832526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e5f14-572a-4c34-a9fd-c8e0542238a1 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:17.833039 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e5f14-572a-4c34-a9fd-c8e0542238a1 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:17.833160 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e5f14-572a-4c34-a9fd-c8e0542238a1 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:17.834381 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 402/801] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:02:17.839796 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c410-8ba0-4ec5-b1f6-b93951ba3745 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:17.840185 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c410-8ba0-4ec5-b1f6-b93951ba3745 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:17.840346 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c410-8ba0-4ec5-b1f6-b93951ba3745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:17.858901 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-6a34c410-8ba0-4ec5-b1f6-b93951ba3745 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:17.860986 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-6a34c410-8ba0-4ec5-b1f6-b93951ba3745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:17.924787 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 400/802] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:17 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:02:18.250086 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e5f14-572a-4c34-a9fd-c8e0542238a1 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:18.347492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:18.351779 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e5f14-572a-4c34-a9fd-c8e0542238a1 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:18.384585 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26ab12-cec3-45cb-9b74-209d02d2d594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:18.385287 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26ab12-cec3-45cb-9b74-209d02d2d594 None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:18.385640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26ab12-cec3-45cb-9b74-209d02d2d594 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:18.385983 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26ab12-cec3-45cb-9b74-209d02d2d594 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:18.386700 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26ab12-cec3-45cb-9b74-209d02d2d594 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:18.388200 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26ab12-cec3-45cb-9b74-209d02d2d594 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:18.402619 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 403/803] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Aug 18 21:02:18 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:18.785942 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95d50d-1c9e-43fe-8a4d-03b8220d614b None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:18.786231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95d50d-1c9e-43fe-8a4d-03b8220d614b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:18.786508 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95d50d-1c9e-43fe-8a4d-03b8220d614b None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:18.787907 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 401/804] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:02:18.793144 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35b54c-94d0-4bf1-9a75-441401379fe7 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:18.793435 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35b54c-94d0-4bf1-9a75-441401379fe7 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:18.793709 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35b54c-94d0-4bf1-9a75-441401379fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:18.812490 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-1f35b54c-94d0-4bf1-9a75-441401379fe7 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:18.813709 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-1f35b54c-94d0-4bf1-9a75-441401379fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:18.885336 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 404/805] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:18 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:02:19.215414 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95d50d-1c9e-43fe-8a4d-03b8220d614b None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:19.280579 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:19.314854 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95d50d-1c9e-43fe-8a4d-03b8220d614b None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:19.347981 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bf44b-c389-4583-8199-c1a76582e9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:19.348583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bf44b-c389-4583-8199-c1a76582e9b1 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:19.348860 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bf44b-c389-4583-8199-c1a76582e9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:19.349132 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bf44b-c389-4583-8199-c1a76582e9b1 None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:19.349766 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bf44b-c389-4583-8199-c1a76582e9b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:19.351182 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bf44b-c389-4583-8199-c1a76582e9b1 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:19.364875 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.sql.core [None req-905bf44b-c389-4583-8199-c1a76582e9b1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 21:02:19.364875 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 21:02:19.364875 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [parameters: {'user_id': '3666e420545d4395b81bad8fce37ddee', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 21:02:19.364875 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88582) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-905bf44b-c389-4583-8199-c1a76582e9b1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application conn.query(q) Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application result.read() Aug 18 21:02:19.371114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 21:02:19.372195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application next(self.gen) Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application yield resource Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application next(self.gen) Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise self.value Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application session.commit() Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 21:02:19.373219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self.session.flush() Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application compat.raise_( Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 21:02:19.374117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 21:02:19.375044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application conn.query(q) Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application result.read() Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 21:02:19.378124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [parameters: {'user_id': '3666e420545d4395b81bad8fce37ddee', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:19.380094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 18 21:02:19.381676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 18 21:02:19.383802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 18 21:02:19.383802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 18 21:02:19.383802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 21:02:19.383802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 21:02:19.383802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 21:02:19.383802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:19.383802 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 402/806] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Aug 18 21:02:19 2022] POST /identity/v3/users => generated 160 bytes in 157 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:19.384289 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35b54c-94d0-4bf1-9a75-441401379fe7 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:19.463240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:19.480036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35b54c-94d0-4bf1-9a75-441401379fe7 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:19.514023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dec7e-6624-47dc-a28d-f51d9fddadce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:19.514642 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dec7e-6624-47dc-a28d-f51d9fddadce None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:19.514924 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dec7e-6624-47dc-a28d-f51d9fddadce None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:19.515190 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dec7e-6624-47dc-a28d-f51d9fddadce None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:19.522830 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dec7e-6624-47dc-a28d-f51d9fddadce None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:19.524316 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dec7e-6624-47dc-a28d-f51d9fddadce None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-834dec7e-6624-47dc-a28d-f51d9fddadce None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:02:19.537279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:19.538344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:19.539426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:19.539426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:19.539426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:02:19.539426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:02:19.539426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:02:19.539426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:02:19.539426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:02:19.539426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:02:19.539426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:02:19.539426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:19.539426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 405/807] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:02:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:19.544688 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bf44b-c389-4583-8199-c1a76582e9b1 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:19.646843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bf44b-c389-4583-8199-c1a76582e9b1 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:19.674680 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:19.681904 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c770f-864a-4520-a11d-3f670379950d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:19.682504 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c770f-864a-4520-a11d-3f670379950d None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:19.682786 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c770f-864a-4520-a11d-3f670379950d None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:19.683058 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c770f-864a-4520-a11d-3f670379950d None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:19.683790 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c770f-864a-4520-a11d-3f670379950d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:19.684099 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c770f-864a-4520-a11d-3f670379950d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:19.685718 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c770f-864a-4520-a11d-3f670379950d None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:19.722869 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 403/808] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Aug 18 21:02:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:20.636082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba70866-d8d3-4b98-9f56-96bb08dd290d None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:20.636531 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba70866-d8d3-4b98-9f56-96bb08dd290d None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:20.636630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba70866-d8d3-4b98-9f56-96bb08dd290d None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:20.637939 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 406/809] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:02:20.643639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b8945-d363-417b-a9ff-e37aebee4491 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:20.644046 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b8945-d363-417b-a9ff-e37aebee4491 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:20.644188 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b8945-d363-417b-a9ff-e37aebee4491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:20.662887 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-ca4b8945-d363-417b-a9ff-e37aebee4491 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:20.664436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-ca4b8945-d363-417b-a9ff-e37aebee4491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:20.731718 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 404/810] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:20 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:02:21.060524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba70866-d8d3-4b98-9f56-96bb08dd290d None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:21.160361 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba70866-d8d3-4b98-9f56-96bb08dd290d None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:21.193032 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc67d99-4fa5-43b2-bfec-31aa207ae367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:21.193644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc67d99-4fa5-43b2-bfec-31aa207ae367 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:21.193923 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc67d99-4fa5-43b2-bfec-31aa207ae367 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:21.194193 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc67d99-4fa5-43b2-bfec-31aa207ae367 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:21.195020 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc67d99-4fa5-43b2-bfec-31aa207ae367 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:21.196416 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc67d99-4fa5-43b2-bfec-31aa207ae367 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-bdc67d99-4fa5-43b2-bfec-31aa207ae367 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:21.204873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:21.206057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:02:21.207093 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 407/811] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:02:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:21.211928 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b8945-d363-417b-a9ff-e37aebee4491 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:21.305770 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b8945-d363-417b-a9ff-e37aebee4491 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:21.323132 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:21.339538 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc5af7-891d-46c3-b40f-040ef2e2c5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:21.340134 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc5af7-891d-46c3-b40f-040ef2e2c5ce None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:21.340415 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc5af7-891d-46c3-b40f-040ef2e2c5ce None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:21.340685 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc5af7-891d-46c3-b40f-040ef2e2c5ce None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:21.341299 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc5af7-891d-46c3-b40f-040ef2e2c5ce None admin] RBAC: Adding query filter params (name=compute) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:21.341599 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc5af7-891d-46c3-b40f-040ef2e2c5ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:21.342960 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc5af7-891d-46c3-b40f-040ef2e2c5ce None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:21.347670 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 405/812] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Aug 18 21:02:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:21.353359 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc67d99-4fa5-43b2-bfec-31aa207ae367 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:21.366327 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:21.452515 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc67d99-4fa5-43b2-bfec-31aa207ae367 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:21.485117 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345771c-e768-48b4-914d-9c484e52d343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:21.485696 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345771c-e768-48b4-914d-9c484e52d343 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:21.485971 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345771c-e768-48b4-914d-9c484e52d343 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:21.486237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345771c-e768-48b4-914d-9c484e52d343 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:21.486843 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345771c-e768-48b4-914d-9c484e52d343 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:21.487139 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345771c-e768-48b4-914d-9c484e52d343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:21.488516 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345771c-e768-48b4-914d-9c484e52d343 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:21.493089 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 408/813] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Aug 18 21:02:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:21.499128 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc5af7-891d-46c3-b40f-040ef2e2c5ce None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:21.596448 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc5af7-891d-46c3-b40f-040ef2e2c5ce None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:21.629073 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d74a1-4b86-4764-b5ea-211a4b797c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:21.629660 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d74a1-4b86-4764-b5ea-211a4b797c2e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:21.629935 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d74a1-4b86-4764-b5ea-211a4b797c2e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:21.630203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d74a1-4b86-4764-b5ea-211a4b797c2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:21.630887 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d74a1-4b86-4764-b5ea-211a4b797c2e None admin] RBAC: Adding query filter params (interface=public, service_id=868ea6d2ce2c4922ab1c14433978a65b, region_id=RegionOne) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:21.631195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d74a1-4b86-4764-b5ea-211a4b797c2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:21.632599 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d74a1-4b86-4764-b5ea-211a4b797c2e None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:21.637358 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 406/814] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Aug 18 21:02:21 2022] GET /identity/v3/endpoints?service_id=868ea6d2ce2c4922ab1c14433978a65b&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:21.643793 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345771c-e768-48b4-914d-9c484e52d343 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:21.715947 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:21.741101 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345771c-e768-48b4-914d-9c484e52d343 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:21.773183 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26d60f-b485-4967-a6e1-95952ad6be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:21.773776 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26d60f-b485-4967-a6e1-95952ad6be0e None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:21.774055 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26d60f-b485-4967-a6e1-95952ad6be0e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:21.774332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26d60f-b485-4967-a6e1-95952ad6be0e None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:21.774988 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26d60f-b485-4967-a6e1-95952ad6be0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:21.776373 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26d60f-b485-4967-a6e1-95952ad6be0e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:21.782938 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 409/815] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Aug 18 21:02:21 2022] GET /identity/v3/services => generated 1728 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:02:23.969229 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f128d9d-a25f-4c6e-a3ae-929c26d23d36 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:23.969727 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f128d9d-a25f-4c6e-a3ae-929c26d23d36 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:23.969727 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f128d9d-a25f-4c6e-a3ae-929c26d23d36 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:23.971006 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 407/816] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:02:23.976109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9f8e8-affa-4fc8-ba90-f06666533f8f None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:23.976491 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9f8e8-affa-4fc8-ba90-f06666533f8f None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:23.976660 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9f8e8-affa-4fc8-ba90-f06666533f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:23.994819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-b5c9f8e8-affa-4fc8-ba90-f06666533f8f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:23.996041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-b5c9f8e8-affa-4fc8-ba90-f06666533f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:24.060588 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 410/817] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:02:23 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:02:24.399501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f128d9d-a25f-4c6e-a3ae-929c26d23d36 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:24.446978 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:24.498486 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f128d9d-a25f-4c6e-a3ae-929c26d23d36 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:24.530781 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1cc2b-badd-40a2-8a36-a41e7aace46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:24.531951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1cc2b-badd-40a2-8a36-a41e7aace46a None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:24.532230 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1cc2b-badd-40a2-8a36-a41e7aace46a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:24.532501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1cc2b-badd-40a2-8a36-a41e7aace46a None admin] PATH_INFO: `/v3/services/compute` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:24.533067 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1cc2b-badd-40a2-8a36-a41e7aace46a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:24.534423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1cc2b-badd-40a2-8a36-a41e7aace46a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-69c1cc2b-badd-40a2-8a36-a41e7aace46a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:02:24.542985 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:02:24.544211 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:02:24.545436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 408/818] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:02:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:02:24.551044 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9f8e8-affa-4fc8-ba90-f06666533f8f None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:24.615956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:24.648872 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9f8e8-affa-4fc8-ba90-f06666533f8f None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:24.681082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf33c11-ca04-48a9-a84e-74ac1545f140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:24.681618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf33c11-ca04-48a9-a84e-74ac1545f140 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:24.681895 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf33c11-ca04-48a9-a84e-74ac1545f140 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:24.682164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf33c11-ca04-48a9-a84e-74ac1545f140 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:24.682777 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf33c11-ca04-48a9-a84e-74ac1545f140 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:24.683080 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf33c11-ca04-48a9-a84e-74ac1545f140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:24.684480 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf33c11-ca04-48a9-a84e-74ac1545f140 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:24.689561 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 411/819] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Aug 18 21:02:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:24.695604 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1cc2b-badd-40a2-8a36-a41e7aace46a None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:24.791364 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1cc2b-badd-40a2-8a36-a41e7aace46a None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:24.801661 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:24.824605 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04672900-80c7-4ef7-a11e-4d55875ae923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:24.825197 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04672900-80c7-4ef7-a11e-4d55875ae923 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:24.825476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04672900-80c7-4ef7-a11e-4d55875ae923 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:24.825749 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04672900-80c7-4ef7-a11e-4d55875ae923 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:24.826370 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04672900-80c7-4ef7-a11e-4d55875ae923 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:24.826672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04672900-80c7-4ef7-a11e-4d55875ae923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:24.828193 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04672900-80c7-4ef7-a11e-4d55875ae923 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:24.832806 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 409/820] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Aug 18 21:02:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:24.838744 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf33c11-ca04-48a9-a84e-74ac1545f140 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:24.934374 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf33c11-ca04-48a9-a84e-74ac1545f140 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:24.963324 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:24.969141 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f98b18-7158-4ec4-87a8-78cf9d9e942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:24.969739 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98b18-7158-4ec4-87a8-78cf9d9e942b None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:24.970018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98b18-7158-4ec4-87a8-78cf9d9e942b None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:24.970285 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98b18-7158-4ec4-87a8-78cf9d9e942b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:24.970938 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f98b18-7158-4ec4-87a8-78cf9d9e942b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:24.972342 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f98b18-7158-4ec4-87a8-78cf9d9e942b None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:24.990460 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 412/821] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Aug 18 21:02:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:34.830477 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=13 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:34.986902 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=5,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:28.946624 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736a2f7-c071-4142-b7fd-ca20a87c4721 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:28.946624 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736a2f7-c071-4142-b7fd-ca20a87c4721 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:28.946624 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736a2f7-c071-4142-b7fd-ca20a87c4721 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:28.946624 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 410/822] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:28.956793 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0e981-47aa-4921-8d32-2602e2f7edbb None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:28.958545 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0e981-47aa-4921-8d32-2602e2f7edbb None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:28.959100 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0e981-47aa-4921-8d32-2602e2f7edbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:28.993337 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-0ef0e981-47aa-4921-8d32-2602e2f7edbb None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:28.995516 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-0ef0e981-47aa-4921-8d32-2602e2f7edbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:29.125989 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 413/823] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:03:28 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:03:29.527195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736a2f7-c071-4142-b7fd-ca20a87c4721 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:29.716170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736a2f7-c071-4142-b7fd-ca20a87c4721 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:29.781984 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c857b9-cb48-4154-9701-b86571ab7297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:29.782901 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c857b9-cb48-4154-9701-b86571ab7297 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:29.783378 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c857b9-cb48-4154-9701-b86571ab7297 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:29.783816 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c857b9-cb48-4154-9701-b86571ab7297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:29.803327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c857b9-cb48-4154-9701-b86571ab7297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:29.805994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c857b9-cb48-4154-9701-b86571ab7297 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-85c857b9-cb48-4154-9701-b86571ab7297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:03:29.834851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:29.836272 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:03:29.838123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:03:29.838123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:29.838123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:29.838123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 411/824] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:03:29.847063 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0e981-47aa-4921-8d32-2602e2f7edbb None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:30.051711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0e981-47aa-4921-8d32-2602e2f7edbb None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:30.086526 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:30.109092 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c3dca-f695-41f1-91e7-f64daba90df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:30.109956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3dca-f695-41f1-91e7-f64daba90df7 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:30.110237 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3dca-f695-41f1-91e7-f64daba90df7 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:30.110517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3dca-f695-41f1-91e7-f64daba90df7 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:30.111426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c3dca-f695-41f1-91e7-f64daba90df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:30.111844 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c3dca-f695-41f1-91e7-f64daba90df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:30.114476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c3dca-f695-41f1-91e7-f64daba90df7 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:30.142178 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 414/825] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:30.151811 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c857b9-cb48-4154-9701-b86571ab7297 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:30.248378 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:30.339094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c857b9-cb48-4154-9701-b86571ab7297 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:30.401852 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cff34-2aaa-4b54-bcb5-eedceebea348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:30.402488 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cff34-2aaa-4b54-bcb5-eedceebea348 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:30.402775 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cff34-2aaa-4b54-bcb5-eedceebea348 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:30.403050 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cff34-2aaa-4b54-bcb5-eedceebea348 None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:30.403752 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cff34-2aaa-4b54-bcb5-eedceebea348 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:30.405280 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cff34-2aaa-4b54-bcb5-eedceebea348 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:30.451299 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 412/826] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Aug 18 21:03:30 2022] POST /identity/v3/users => generated 251 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:03:33.177839 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852c8a1-8cc6-4264-bc25-84246598c87e None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:33.183603 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852c8a1-8cc6-4264-bc25-84246598c87e None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:33.183603 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852c8a1-8cc6-4264-bc25-84246598c87e None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:33.183603 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 415/827] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:33.188133 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870eaf4-1d8f-4aab-9fbb-6b0276e58a64 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:33.188830 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870eaf4-1d8f-4aab-9fbb-6b0276e58a64 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:33.188998 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870eaf4-1d8f-4aab-9fbb-6b0276e58a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:33.214434 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-7870eaf4-1d8f-4aab-9fbb-6b0276e58a64 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:33.216124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-7870eaf4-1d8f-4aab-9fbb-6b0276e58a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:33.327379 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 413/828] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:03:33 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:03:33.721197 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852c8a1-8cc6-4264-bc25-84246598c87e None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:33.904291 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852c8a1-8cc6-4264-bc25-84246598c87e None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:33.959128 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec9582-0446-4b4b-83da-330f109c8940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:33.960201 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec9582-0446-4b4b-83da-330f109c8940 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:33.960692 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec9582-0446-4b4b-83da-330f109c8940 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:33.961148 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec9582-0446-4b4b-83da-330f109c8940 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:33.976995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec9582-0446-4b4b-83da-330f109c8940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-1eec9582-0446-4b4b-83da-330f109c8940 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:03:33.982224 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:33.984000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:33.985057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:33.985057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:33.985057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:33.985057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:33.985057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:03:33.985057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:03:33.985057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:03:33.985057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:03:33.985057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:03:33.985057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:03:33.985057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:03:33.985057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:33.985057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 416/829] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:03:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:33.992322 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870eaf4-1d8f-4aab-9fbb-6b0276e58a64 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:34.050129 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:34.150358 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870eaf4-1d8f-4aab-9fbb-6b0276e58a64 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:34.212793 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f70324-d84b-4122-991f-e5ed8b141adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:34.214221 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70324-d84b-4122-991f-e5ed8b141adb None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:34.214697 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70324-d84b-4122-991f-e5ed8b141adb None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:34.215152 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70324-d84b-4122-991f-e5ed8b141adb None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:34.216311 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f70324-d84b-4122-991f-e5ed8b141adb None admin] RBAC: Adding query filter params (name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:34.216830 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f70324-d84b-4122-991f-e5ed8b141adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:34.219201 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f70324-d84b-4122-991f-e5ed8b141adb None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:34.234987 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 414/830] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:03:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:03:34.241511 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec9582-0446-4b4b-83da-330f109c8940 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:34.326938 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:34.427824 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec9582-0446-4b4b-83da-330f109c8940 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:34.477012 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53ff2e-4fe6-46ed-9461-430d03b72b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:34.477785 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ff2e-4fe6-46ed-9461-430d03b72b40 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:34.478056 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ff2e-4fe6-46ed-9461-430d03b72b40 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:34.478381 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ff2e-4fe6-46ed-9461-430d03b72b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:34.500593 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53ff2e-4fe6-46ed-9461-430d03b72b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:34.503882 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53ff2e-4fe6-46ed-9461-430d03b72b40 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-6b53ff2e-4fe6-46ed-9461-430d03b72b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:03:34.535840 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:34.537791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:03:34.539742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:03:34.539742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:34.539742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:34.539742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 417/831] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:34.546178 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f70324-d84b-4122-991f-e5ed8b141adb None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:34.696695 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:34.700884 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f70324-d84b-4122-991f-e5ed8b141adb None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:34.760919 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4490e0b-f9e4-4d74-8754-5e53571b2839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:34.760919 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4490e0b-f9e4-4d74-8754-5e53571b2839 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:34.760919 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4490e0b-f9e4-4d74-8754-5e53571b2839 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:34.760919 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4490e0b-f9e4-4d74-8754-5e53571b2839 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:34.761754 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4490e0b-f9e4-4d74-8754-5e53571b2839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:34.761754 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4490e0b-f9e4-4d74-8754-5e53571b2839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:34.763127 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4490e0b-f9e4-4d74-8754-5e53571b2839 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:34.777706 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 415/832] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:34.785095 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53ff2e-4fe6-46ed-9461-430d03b72b40 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:34.970057 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:34.976641 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53ff2e-4fe6-46ed-9461-430d03b72b40 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:35.035713 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bf5b9-2358-4aad-abe8-909537f2605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:35.036674 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bf5b9-2358-4aad-abe8-909537f2605c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:35.037047 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bf5b9-2358-4aad-abe8-909537f2605c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:35.037524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bf5b9-2358-4aad-abe8-909537f2605c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:35.049778 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bf5b9-2358-4aad-abe8-909537f2605c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:35.053282 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bf5b9-2358-4aad-abe8-909537f2605c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-964bf5b9-2358-4aad-abe8-909537f2605c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:03:35.074121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:35.076320 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:35.078821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:35.078821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:35.078821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:03:35.078821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:03:35.078821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:03:35.078821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:03:35.078821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:03:35.078821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:03:35.078821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:03:35.078821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:35.078821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 418/833] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:35.085003 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4490e0b-f9e4-4d74-8754-5e53571b2839 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:35.256938 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4490e0b-f9e4-4d74-8754-5e53571b2839 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:35.312654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59eec0-66da-4aab-90d8-14224587d7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:35.313397 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59eec0-66da-4aab-90d8-14224587d7a1 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:35.313791 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59eec0-66da-4aab-90d8-14224587d7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:35.314426 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59eec0-66da-4aab-90d8-14224587d7a1 None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:35.315285 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59eec0-66da-4aab-90d8-14224587d7a1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:35.315782 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59eec0-66da-4aab-90d8-14224587d7a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:35.317517 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59eec0-66da-4aab-90d8-14224587d7a1 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:35.343714 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 416/834] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Aug 18 21:03:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:35.349859 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bf5b9-2358-4aad-abe8-909537f2605c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:35.528742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bf5b9-2358-4aad-abe8-909537f2605c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:35.585617 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f719e5b-e704-4021-b8e5-e1d39acc232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:35.586220 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719e5b-e704-4021-b8e5-e1d39acc232c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:35.586559 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719e5b-e704-4021-b8e5-e1d39acc232c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:35.586893 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719e5b-e704-4021-b8e5-e1d39acc232c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:35.626646 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:35.701470 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f719e5b-e704-4021-b8e5-e1d39acc232c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:35.704276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f719e5b-e704-4021-b8e5-e1d39acc232c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:35.865214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 419/835] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:03:35 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 21:03:35.871177 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59eec0-66da-4aab-90d8-14224587d7a1 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:35.893981 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:36.007605 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59eec0-66da-4aab-90d8-14224587d7a1 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:36.066729 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a4fe7-d99f-435b-a6ac-bef102c1befb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:36.067939 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a4fe7-d99f-435b-a6ac-bef102c1befb None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:36.068430 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a4fe7-d99f-435b-a6ac-bef102c1befb None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:36.068936 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a4fe7-d99f-435b-a6ac-bef102c1befb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:36.089984 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a4fe7-d99f-435b-a6ac-bef102c1befb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:36.092797 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a4fe7-d99f-435b-a6ac-bef102c1befb None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-b76a4fe7-d99f-435b-a6ac-bef102c1befb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:03:36.121347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:36.122520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:03:36.123513 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:03:36.123513 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:36.123513 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:36.124041 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 417/836] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:36.132127 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f719e5b-e704-4021-b8e5-e1d39acc232c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:36.225689 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:36.283675 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f719e5b-e704-4021-b8e5-e1d39acc232c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:36.331690 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe38ea5-849d-485b-93c9-bd21fced4e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:36.332301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe38ea5-849d-485b-93c9-bd21fced4e18 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:36.332579 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe38ea5-849d-485b-93c9-bd21fced4e18 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:36.332980 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe38ea5-849d-485b-93c9-bd21fced4e18 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:36.333574 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe38ea5-849d-485b-93c9-bd21fced4e18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:36.333917 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe38ea5-849d-485b-93c9-bd21fced4e18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:36.335448 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe38ea5-849d-485b-93c9-bd21fced4e18 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:36.350411 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 420/837] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:03:36.359162 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a4fe7-d99f-435b-a6ac-bef102c1befb None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:36.468951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:36.516428 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a4fe7-d99f-435b-a6ac-bef102c1befb None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:36.570164 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee273210-9185-4bd0-bb87-7fba0d8639d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:36.571066 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee273210-9185-4bd0-bb87-7fba0d8639d1 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:36.571548 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee273210-9185-4bd0-bb87-7fba0d8639d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:36.572010 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee273210-9185-4bd0-bb87-7fba0d8639d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:36.585565 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee273210-9185-4bd0-bb87-7fba0d8639d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:36.587778 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee273210-9185-4bd0-bb87-7fba0d8639d1 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-ee273210-9185-4bd0-bb87-7fba0d8639d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:03:36.605403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:36.607135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:36.609385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:03:36.609385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:03:36.609385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:03:36.609385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:03:36.609385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:03:36.609385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:03:36.609385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:03:36.609385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:36.609385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 418/838] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:36.616524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe38ea5-849d-485b-93c9-bd21fced4e18 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:36.764665 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe38ea5-849d-485b-93c9-bd21fced4e18 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:36.783186 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:36.803872 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92696ff-0b6d-4946-9b1a-8058a649836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:36.804622 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92696ff-0b6d-4946-9b1a-8058a649836e None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:36.805000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92696ff-0b6d-4946-9b1a-8058a649836e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:36.805367 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92696ff-0b6d-4946-9b1a-8058a649836e None admin] PATH_INFO: `/v3/projects` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:36.806182 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92696ff-0b6d-4946-9b1a-8058a649836e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:36.806587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92696ff-0b6d-4946-9b1a-8058a649836e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:36.808845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92696ff-0b6d-4946-9b1a-8058a649836e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:36.822615 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 421/839] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:03:36.832312 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee273210-9185-4bd0-bb87-7fba0d8639d1 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:36.964258 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee273210-9185-4bd0-bb87-7fba0d8639d1 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:37.006247 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:37.014889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea8540-c78e-4b29-80f0-c68b14cd6abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:37.015672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea8540-c78e-4b29-80f0-c68b14cd6abc None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:37.016028 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea8540-c78e-4b29-80f0-c68b14cd6abc None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:37.016353 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea8540-c78e-4b29-80f0-c68b14cd6abc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:37.017293 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea8540-c78e-4b29-80f0-c68b14cd6abc None admin] RBAC: Adding query filter params (role.id=c1a49401a509407295b9fff1cf635344, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=42119f8b3cd5446ea7aca396ad1a0f6d) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:37.017763 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea8540-c78e-4b29-80f0-c68b14cd6abc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:37.020045 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea8540-c78e-4b29-80f0-c68b14cd6abc None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:37.028658 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 419/840] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:03:36 2022] GET /identity/v3/role_assignments?user.id=42119f8b3cd5446ea7aca396ad1a0f6d&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=c1a49401a509407295b9fff1cf635344 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:39.423358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95c89c-a282-4174-928e-d695ebf5a317 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:39.424432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95c89c-a282-4174-928e-d695ebf5a317 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:39.424432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95c89c-a282-4174-928e-d695ebf5a317 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:39.426931 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 422/841] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:39.431717 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402320b7-38cd-499a-8412-e994b74fcd2f None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:39.433118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402320b7-38cd-499a-8412-e994b74fcd2f None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:39.433118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402320b7-38cd-499a-8412-e994b74fcd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:39.457302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-402320b7-38cd-499a-8412-e994b74fcd2f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:39.458529 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-402320b7-38cd-499a-8412-e994b74fcd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:39.538124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 420/842] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:03:39 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:03:39.881104 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95c89c-a282-4174-928e-d695ebf5a317 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:40.026284 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95c89c-a282-4174-928e-d695ebf5a317 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:40.082288 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a80fa-2316-46d2-8a73-3514882c94f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:40.082947 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a80fa-2316-46d2-8a73-3514882c94f7 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:40.083226 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a80fa-2316-46d2-8a73-3514882c94f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:40.083643 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a80fa-2316-46d2-8a73-3514882c94f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:40.096602 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a80fa-2316-46d2-8a73-3514882c94f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-7e4a80fa-2316-46d2-8a73-3514882c94f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:03:40.101956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:40.104005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:40.106078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:40.106078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:40.106078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:40.106078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:40.106078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:03:40.106078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:03:40.106078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:03:40.106078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:03:40.106078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:03:40.106078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:03:40.106078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:03:40.106078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:40.106078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 423/843] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:03:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:40.110171 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402320b7-38cd-499a-8412-e994b74fcd2f None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:40.264194 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402320b7-38cd-499a-8412-e994b74fcd2f None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:40.297592 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:40.313305 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608ded9-0a6a-401e-831f-534b85bcdc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:40.314338 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608ded9-0a6a-401e-831f-534b85bcdc07 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:40.314772 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608ded9-0a6a-401e-831f-534b85bcdc07 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:40.315377 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608ded9-0a6a-401e-831f-534b85bcdc07 None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:40.316228 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608ded9-0a6a-401e-831f-534b85bcdc07 None admin] RBAC: Adding query filter params (name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:40.316591 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608ded9-0a6a-401e-831f-534b85bcdc07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:40.318126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608ded9-0a6a-401e-831f-534b85bcdc07 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:40.328009 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 421/844] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:03:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:40.333994 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a80fa-2316-46d2-8a73-3514882c94f7 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:40.378099 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:40.462897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a80fa-2316-46d2-8a73-3514882c94f7 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:40.504597 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ba3fb-5643-4120-8175-bdd85d1177e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:40.505329 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ba3fb-5643-4120-8175-bdd85d1177e9 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:40.505654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ba3fb-5643-4120-8175-bdd85d1177e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:40.505972 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ba3fb-5643-4120-8175-bdd85d1177e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:40.524862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ba3fb-5643-4120-8175-bdd85d1177e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:40.526393 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ba3fb-5643-4120-8175-bdd85d1177e9 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-279ba3fb-5643-4120-8175-bdd85d1177e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:03:40.542712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:40.544860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:03:40.546135 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:03:40.546135 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:40.546135 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:40.546135 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 424/845] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:40.549993 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608ded9-0a6a-401e-831f-534b85bcdc07 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:40.674274 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608ded9-0a6a-401e-831f-534b85bcdc07 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:40.710502 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23057488-9633-4224-a8f3-e1d6b440f64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:40.711254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23057488-9633-4224-a8f3-e1d6b440f64a None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:40.711568 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23057488-9633-4224-a8f3-e1d6b440f64a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:40.711839 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23057488-9633-4224-a8f3-e1d6b440f64a None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:40.713103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23057488-9633-4224-a8f3-e1d6b440f64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:40.713416 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23057488-9633-4224-a8f3-e1d6b440f64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:40.714897 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23057488-9633-4224-a8f3-e1d6b440f64a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:40.730064 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 422/846] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:03:40.738954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ba3fb-5643-4120-8175-bdd85d1177e9 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:40.849920 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:40.861742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ba3fb-5643-4120-8175-bdd85d1177e9 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:40.905753 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac85e5-9b97-43d2-8da4-6ebad32966e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:40.906733 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac85e5-9b97-43d2-8da4-6ebad32966e0 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:40.907193 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac85e5-9b97-43d2-8da4-6ebad32966e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:40.907685 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac85e5-9b97-43d2-8da4-6ebad32966e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:40.918283 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac85e5-9b97-43d2-8da4-6ebad32966e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:40.919782 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac85e5-9b97-43d2-8da4-6ebad32966e0 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-00ac85e5-9b97-43d2-8da4-6ebad32966e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:03:40.932018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:40.933528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:40.934973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:40.934973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:40.934973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:03:40.934973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:03:40.934973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:03:40.934973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:03:40.934973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:03:40.934973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:03:40.934973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:03:40.934973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:40.934973 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 425/847] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:03:40.939558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23057488-9633-4224-a8f3-e1d6b440f64a None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:40.993434 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:41.062414 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23057488-9633-4224-a8f3-e1d6b440f64a None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:41.103980 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d7ec0-3676-48fa-94c0-08867e46f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:41.104508 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d7ec0-3676-48fa-94c0-08867e46f138 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:41.104786 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d7ec0-3676-48fa-94c0-08867e46f138 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:41.105056 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d7ec0-3676-48fa-94c0-08867e46f138 None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:41.105787 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d7ec0-3676-48fa-94c0-08867e46f138 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:41.106089 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d7ec0-3676-48fa-94c0-08867e46f138 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:41.107573 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d7ec0-3676-48fa-94c0-08867e46f138 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:41.128013 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 423/848] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Aug 18 21:03:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:03:41.133954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac85e5-9b97-43d2-8da4-6ebad32966e0 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:41.264918 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac85e5-9b97-43d2-8da4-6ebad32966e0 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:41.307519 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec209ee3-491e-4d85-9c08-afb14605d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:41.308533 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec209ee3-491e-4d85-9c08-afb14605d97b None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:41.309115 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec209ee3-491e-4d85-9c08-afb14605d97b None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:41.309576 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec209ee3-491e-4d85-9c08-afb14605d97b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:41.332378 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec209ee3-491e-4d85-9c08-afb14605d97b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:41.336118 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec209ee3-491e-4d85-9c08-afb14605d97b None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-ec209ee3-491e-4d85-9c08-afb14605d97b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:03:41.368281 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:41.370110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:03:41.371150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:03:41.371150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:41.371150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:41.371150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 426/849] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:41.376687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d7ec0-3676-48fa-94c0-08867e46f138 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:41.496613 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d7ec0-3676-48fa-94c0-08867e46f138 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:41.498958 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:41.533894 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8df69-c587-48a4-87bb-94c44c9c691f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:41.534514 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8df69-c587-48a4-87bb-94c44c9c691f None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:41.534791 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8df69-c587-48a4-87bb-94c44c9c691f None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:41.535056 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8df69-c587-48a4-87bb-94c44c9c691f None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:41.535747 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8df69-c587-48a4-87bb-94c44c9c691f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:41.536046 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8df69-c587-48a4-87bb-94c44c9c691f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:41.537412 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8df69-c587-48a4-87bb-94c44c9c691f None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:41.550747 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 424/850] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:41.556612 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec209ee3-491e-4d85-9c08-afb14605d97b None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:41.559613 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:41.697830 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec209ee3-491e-4d85-9c08-afb14605d97b None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:41.757809 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6016b9-5ac8-4fb3-8a2b-c9354307ddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:41.758452 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6016b9-5ac8-4fb3-8a2b-c9354307ddd2 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:41.758744 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6016b9-5ac8-4fb3-8a2b-c9354307ddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:41.759018 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6016b9-5ac8-4fb3-8a2b-c9354307ddd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:41.766842 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6016b9-5ac8-4fb3-8a2b-c9354307ddd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:41.768476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6016b9-5ac8-4fb3-8a2b-c9354307ddd2 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-ef6016b9-5ac8-4fb3-8a2b-c9354307ddd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:03:41.782164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:41.783356 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:41.784580 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:03:41.784580 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:03:41.784580 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:03:41.784580 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:03:41.784580 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:03:41.784580 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:03:41.784580 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:03:41.784580 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:41.784580 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 427/851] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:41.790242 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8df69-c587-48a4-87bb-94c44c9c691f None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:41.920587 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8df69-c587-48a4-87bb-94c44c9c691f None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:41.970915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee0077-d5cc-4577-9bd2-d63308ffeba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:41.971607 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee0077-d5cc-4577-9bd2-d63308ffeba5 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:41.971896 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee0077-d5cc-4577-9bd2-d63308ffeba5 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:41.972200 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee0077-d5cc-4577-9bd2-d63308ffeba5 None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:41.972875 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee0077-d5cc-4577-9bd2-d63308ffeba5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:41.973250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee0077-d5cc-4577-9bd2-d63308ffeba5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:41.974799 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee0077-d5cc-4577-9bd2-d63308ffeba5 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:42.001341 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 425/852] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:42.003087 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6016b9-5ac8-4fb3-8a2b-c9354307ddd2 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:42.078300 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:42.125701 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6016b9-5ac8-4fb3-8a2b-c9354307ddd2 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:42.179672 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c6863-9f0c-4850-9f12-453aeb3f6c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:42.180424 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c6863-9f0c-4850-9f12-453aeb3f6c5c None admin] REQUEST_METHOD: `PUT` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:42.180784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c6863-9f0c-4850-9f12-453aeb3f6c5c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:42.181688 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c6863-9f0c-4850-9f12-453aeb3f6c5c None admin] PATH_INFO: `/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/42119f8b3cd5446ea7aca396ad1a0f6d/roles/c1a49401a509407295b9fff1cf635344` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:42.200776 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c6863-9f0c-4850-9f12-453aeb3f6c5c None admin] RBAC: Authorizing `identity:create_grant(project_id=55812d15e0dc4e75bb9a31abfa3387bf, user_id=42119f8b3cd5446ea7aca396ad1a0f6d, role_id=c1a49401a509407295b9fff1cf635344)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:42.202637 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c6863-9f0c-4850-9f12-453aeb3f6c5c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:42.215897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 428/853] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:03:42 2022] PUT /identity/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/42119f8b3cd5446ea7aca396ad1a0f6d/roles/c1a49401a509407295b9fff1cf635344 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:03:44.388022 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a1459-6ac2-436f-bb25-418dbf389e18 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:44.388755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a1459-6ac2-436f-bb25-418dbf389e18 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:44.388755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a1459-6ac2-436f-bb25-418dbf389e18 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:44.390094 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 426/854] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:44.396050 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d8794-339c-4d2d-ba2b-5561f509c500 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:44.396505 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d8794-339c-4d2d-ba2b-5561f509c500 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:44.396614 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d8794-339c-4d2d-ba2b-5561f509c500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:44.416608 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-312d8794-339c-4d2d-ba2b-5561f509c500 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:44.417768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-312d8794-339c-4d2d-ba2b-5561f509c500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:44.495740 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 429/855] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:03:44 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:03:44.840071 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a1459-6ac2-436f-bb25-418dbf389e18 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:44.866836 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:44.949594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a1459-6ac2-436f-bb25-418dbf389e18 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:44.986159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5df5eb-651c-412c-8d9d-6f5501ecf8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:44.986784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5df5eb-651c-412c-8d9d-6f5501ecf8a3 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:44.987064 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5df5eb-651c-412c-8d9d-6f5501ecf8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:44.987364 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5df5eb-651c-412c-8d9d-6f5501ecf8a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:44.997930 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5df5eb-651c-412c-8d9d-6f5501ecf8a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-ea5df5eb-651c-412c-8d9d-6f5501ecf8a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:03:45.002588 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:45.003639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:45.004497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:45.004497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:45.004497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:45.004497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:45.004497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:03:45.004497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:03:45.004497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:03:45.004497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:03:45.004497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:03:45.004497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:03:45.004497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:03:45.004497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:45.004497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 427/856] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Aug 18 21:03:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:45.010235 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d8794-339c-4d2d-ba2b-5561f509c500 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:45.057683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:45.121836 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d8794-339c-4d2d-ba2b-5561f509c500 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:45.159845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e08da1-5f12-4624-a2e4-edb03244e86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:45.160495 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e08da1-5f12-4624-a2e4-edb03244e86f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:45.160722 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e08da1-5f12-4624-a2e4-edb03244e86f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:45.160969 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e08da1-5f12-4624-a2e4-edb03244e86f None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:45.161650 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e08da1-5f12-4624-a2e4-edb03244e86f None admin] RBAC: Adding query filter params (name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:45.161928 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e08da1-5f12-4624-a2e4-edb03244e86f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:45.163304 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e08da1-5f12-4624-a2e4-edb03244e86f None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:45.172161 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 430/857] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Aug 18 21:03:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:45.178265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5df5eb-651c-412c-8d9d-6f5501ecf8a3 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:45.270682 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:45.287719 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5df5eb-651c-412c-8d9d-6f5501ecf8a3 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:45.324686 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdb3c8-0e0a-41d3-923d-90b6cacee676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:45.325447 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdb3c8-0e0a-41d3-923d-90b6cacee676 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:45.325621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdb3c8-0e0a-41d3-923d-90b6cacee676 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:45.325891 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdb3c8-0e0a-41d3-923d-90b6cacee676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:45.337511 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdb3c8-0e0a-41d3-923d-90b6cacee676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:45.338987 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdb3c8-0e0a-41d3-923d-90b6cacee676 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-10cdb3c8-0e0a-41d3-923d-90b6cacee676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:03:45.353843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:45.355035 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:03:45.356117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:03:45.356117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:45.356117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:45.356117 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 428/858] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:45.360724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e08da1-5f12-4624-a2e4-edb03244e86f None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:45.470631 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e08da1-5f12-4624-a2e4-edb03244e86f None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:45.472991 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:45.505930 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfc265-7c64-4589-9395-71e9b17c44fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:45.506524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfc265-7c64-4589-9395-71e9b17c44fe None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:45.506800 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfc265-7c64-4589-9395-71e9b17c44fe None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:45.507070 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfc265-7c64-4589-9395-71e9b17c44fe None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:45.507763 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfc265-7c64-4589-9395-71e9b17c44fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:45.508046 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfc265-7c64-4589-9395-71e9b17c44fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:45.509997 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfc265-7c64-4589-9395-71e9b17c44fe None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:45.522615 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 431/859] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:45.528251 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdb3c8-0e0a-41d3-923d-90b6cacee676 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:45.632388 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdb3c8-0e0a-41d3-923d-90b6cacee676 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:45.669717 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7597e5-906f-4c69-860b-b8238c7bf5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:45.670342 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7597e5-906f-4c69-860b-b8238c7bf5af None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:45.670623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7597e5-906f-4c69-860b-b8238c7bf5af None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:45.670891 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7597e5-906f-4c69-860b-b8238c7bf5af None admin] PATH_INFO: `/v3/users/placement` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:45.673632 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:45.679029 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7597e5-906f-4c69-860b-b8238c7bf5af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:45.680729 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7597e5-906f-4c69-860b-b8238c7bf5af None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-dc7597e5-906f-4c69-860b-b8238c7bf5af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:03:45.692710 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:45.693917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:45.695135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:45.695135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:45.695135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:03:45.695135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:03:45.695135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:03:45.695135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:03:45.695135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:03:45.695135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:03:45.695135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:03:45.695135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:45.695135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 429/860] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:45.699804 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfc265-7c64-4589-9395-71e9b17c44fe None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:45.804073 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfc265-7c64-4589-9395-71e9b17c44fe None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:45.840169 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d77e44-eac0-446b-b3bb-c7bbf5b5134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:45.840829 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d77e44-eac0-446b-b3bb-c7bbf5b5134d None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:45.841124 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d77e44-eac0-446b-b3bb-c7bbf5b5134d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:45.841403 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d77e44-eac0-446b-b3bb-c7bbf5b5134d None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:45.842121 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d77e44-eac0-446b-b3bb-c7bbf5b5134d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:45.842472 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d77e44-eac0-446b-b3bb-c7bbf5b5134d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:45.844069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d77e44-eac0-446b-b3bb-c7bbf5b5134d None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:45.862870 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 432/861] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Aug 18 21:03:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:03:45.869904 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7597e5-906f-4c69-860b-b8238c7bf5af None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:45.981578 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7597e5-906f-4c69-860b-b8238c7bf5af None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:46.020224 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef1d3b-8d7d-448d-8612-2c562c44eb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:46.020872 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef1d3b-8d7d-448d-8612-2c562c44eb36 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:46.021146 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef1d3b-8d7d-448d-8612-2c562c44eb36 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:46.021407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef1d3b-8d7d-448d-8612-2c562c44eb36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:46.085138 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:46.092488 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef1d3b-8d7d-448d-8612-2c562c44eb36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:46.094111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef1d3b-8d7d-448d-8612-2c562c44eb36 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:46.203572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 430/862] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:03:45 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 21:03:46.210179 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d77e44-eac0-446b-b3bb-c7bbf5b5134d None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:46.237774 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:46.317105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d77e44-eac0-446b-b3bb-c7bbf5b5134d None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:46.354795 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a1632-59a1-4d39-94c2-8f206d5080a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:46.355381 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a1632-59a1-4d39-94c2-8f206d5080a7 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:46.355683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a1632-59a1-4d39-94c2-8f206d5080a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:46.356044 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a1632-59a1-4d39-94c2-8f206d5080a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:46.367116 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a1632-59a1-4d39-94c2-8f206d5080a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:46.368963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a1632-59a1-4d39-94c2-8f206d5080a7 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-110a1632-59a1-4d39-94c2-8f206d5080a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:03:46.383624 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:46.385358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:03:46.386493 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:03:46.386493 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:46.386493 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:46.386493 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 433/863] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:46.391767 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef1d3b-8d7d-448d-8612-2c562c44eb36 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:46.493711 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:46.500429 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef1d3b-8d7d-448d-8612-2c562c44eb36 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:46.536920 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c2886-905f-4b91-8deb-8fa9522266fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:46.537566 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c2886-905f-4b91-8deb-8fa9522266fe None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:46.537841 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c2886-905f-4b91-8deb-8fa9522266fe None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:46.538137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c2886-905f-4b91-8deb-8fa9522266fe None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:46.538819 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c2886-905f-4b91-8deb-8fa9522266fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:46.539126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c2886-905f-4b91-8deb-8fa9522266fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:46.540657 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c2886-905f-4b91-8deb-8fa9522266fe None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:46.552835 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 431/864] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:46.559330 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a1632-59a1-4d39-94c2-8f206d5080a7 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:46.643628 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:46.671702 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a1632-59a1-4d39-94c2-8f206d5080a7 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:46.710066 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07d496-ad1c-4d5c-81d3-6b51d829594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:46.710784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07d496-ad1c-4d5c-81d3-6b51d829594c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:46.711077 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07d496-ad1c-4d5c-81d3-6b51d829594c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:46.711373 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07d496-ad1c-4d5c-81d3-6b51d829594c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:46.718325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07d496-ad1c-4d5c-81d3-6b51d829594c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:46.719801 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07d496-ad1c-4d5c-81d3-6b51d829594c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-7d07d496-ad1c-4d5c-81d3-6b51d829594c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:03:46.731107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:46.732248 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:46.733139 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:03:46.733139 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:03:46.733139 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:03:46.733139 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:03:46.733139 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:03:46.733139 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:03:46.733139 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:03:46.733139 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:46.733139 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 434/865] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:46.738013 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c2886-905f-4b91-8deb-8fa9522266fe None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:46.849400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c2886-905f-4b91-8deb-8fa9522266fe None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:46.887987 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9a2f5-99fe-42f4-8d41-38ad31051ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:46.888585 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9a2f5-99fe-42f4-8d41-38ad31051ed2 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:46.888864 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9a2f5-99fe-42f4-8d41-38ad31051ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:46.889132 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9a2f5-99fe-42f4-8d41-38ad31051ed2 None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:46.889811 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9a2f5-99fe-42f4-8d41-38ad31051ed2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:46.890114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9a2f5-99fe-42f4-8d41-38ad31051ed2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:46.891570 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9a2f5-99fe-42f4-8d41-38ad31051ed2 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:46.904147 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 432/866] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:46.910322 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07d496-ad1c-4d5c-81d3-6b51d829594c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:47.014421 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07d496-ad1c-4d5c-81d3-6b51d829594c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:47.049454 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272ff5-30fd-4861-b065-817609362c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:47.050064 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272ff5-30fd-4861-b065-817609362c17 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:47.050348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272ff5-30fd-4861-b065-817609362c17 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:47.050679 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272ff5-30fd-4861-b065-817609362c17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:47.051381 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc272ff5-30fd-4861-b065-817609362c17 None admin] RBAC: Adding query filter params (role.id=c1a49401a509407295b9fff1cf635344, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=42119f8b3cd5446ea7aca396ad1a0f6d) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:47.051771 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc272ff5-30fd-4861-b065-817609362c17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:47.053189 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc272ff5-30fd-4861-b065-817609362c17 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:47.055108 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:47.070497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 435/867] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:03:46 2022] GET /identity/v3/role_assignments?user.id=42119f8b3cd5446ea7aca396ad1a0f6d&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=c1a49401a509407295b9fff1cf635344 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:49.303502 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51822-a17d-4eba-ad89-6666176973ab None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:49.304034 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51822-a17d-4eba-ad89-6666176973ab None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:49.304034 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51822-a17d-4eba-ad89-6666176973ab None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:49.305431 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 433/868] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:03:49.311428 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ae18a-a46e-4f1a-a2e2-95f5caec0211 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:49.311859 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ae18a-a46e-4f1a-a2e2-95f5caec0211 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:49.312111 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ae18a-a46e-4f1a-a2e2-95f5caec0211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:49.332980 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-7a1ae18a-a46e-4f1a-a2e2-95f5caec0211 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:49.334190 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-7a1ae18a-a46e-4f1a-a2e2-95f5caec0211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:49.408498 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 436/869] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:03:49 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:03:49.737126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c51822-a17d-4eba-ad89-6666176973ab None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:49.755876 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:49.851691 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c51822-a17d-4eba-ad89-6666176973ab None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:49.889041 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252159b6-05b8-4264-bc92-760d8c52b5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:49.889587 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252159b6-05b8-4264-bc92-760d8c52b5d1 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:49.889866 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252159b6-05b8-4264-bc92-760d8c52b5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:49.890132 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252159b6-05b8-4264-bc92-760d8c52b5d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:49.900610 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252159b6-05b8-4264-bc92-760d8c52b5d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-252159b6-05b8-4264-bc92-760d8c52b5d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:03:49.905252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:49.906438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:49.907523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:49.907523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:49.907523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:49.907523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:49.907523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:03:49.907523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:03:49.907523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:03:49.907523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:03:49.907523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:03:49.907523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:03:49.907523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:03:49.907523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:49.907523 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 434/870] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:49.912302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ae18a-a46e-4f1a-a2e2-95f5caec0211 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:50.015406 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ae18a-a46e-4f1a-a2e2-95f5caec0211 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:50.045940 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:50.056425 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294f05a-a77b-41be-965e-b26e21b418cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:50.056987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294f05a-a77b-41be-965e-b26e21b418cc None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:50.057268 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294f05a-a77b-41be-965e-b26e21b418cc None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:50.057541 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294f05a-a77b-41be-965e-b26e21b418cc None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:50.058199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294f05a-a77b-41be-965e-b26e21b418cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:50.058502 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294f05a-a77b-41be-965e-b26e21b418cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:50.059914 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294f05a-a77b-41be-965e-b26e21b418cc None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:50.069046 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 437/871] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:03:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:50.075184 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252159b6-05b8-4264-bc92-760d8c52b5d1 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:50.161924 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:50.187133 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252159b6-05b8-4264-bc92-760d8c52b5d1 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:50.222803 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09945107-2a27-44d4-9c24-49ce453d373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:50.223460 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09945107-2a27-44d4-9c24-49ce453d373a None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:50.223743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09945107-2a27-44d4-9c24-49ce453d373a None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:50.224011 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09945107-2a27-44d4-9c24-49ce453d373a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:50.236252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09945107-2a27-44d4-9c24-49ce453d373a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:50.237943 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09945107-2a27-44d4-9c24-49ce453d373a None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-09945107-2a27-44d4-9c24-49ce453d373a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:03:50.256327 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:50.257313 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:03:50.258223 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:03:50.258223 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:50.258223 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:50.258223 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 435/872] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:50.263997 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294f05a-a77b-41be-965e-b26e21b418cc None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:50.400313 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294f05a-a77b-41be-965e-b26e21b418cc None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:50.447854 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07872-a85c-4400-8910-3970aadda0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:50.447854 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07872-a85c-4400-8910-3970aadda0ab None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:50.448152 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07872-a85c-4400-8910-3970aadda0ab None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:50.448429 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07872-a85c-4400-8910-3970aadda0ab None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:50.449058 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d07872-a85c-4400-8910-3970aadda0ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:50.449359 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d07872-a85c-4400-8910-3970aadda0ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:50.450713 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d07872-a85c-4400-8910-3970aadda0ab None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:50.463306 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 438/873] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:50.469165 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09945107-2a27-44d4-9c24-49ce453d373a None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:50.574144 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09945107-2a27-44d4-9c24-49ce453d373a None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:50.604307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:50.612981 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dc8ec-2423-46f1-b93a-e2eea0dd21b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:50.613607 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc8ec-2423-46f1-b93a-e2eea0dd21b3 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:50.613880 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc8ec-2423-46f1-b93a-e2eea0dd21b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:50.614149 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc8ec-2423-46f1-b93a-e2eea0dd21b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:50.622064 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dc8ec-2423-46f1-b93a-e2eea0dd21b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:50.623609 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dc8ec-2423-46f1-b93a-e2eea0dd21b3 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-2a1dc8ec-2423-46f1-b93a-e2eea0dd21b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:03:50.635195 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:50.636222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:50.637170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:50.637170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:50.637170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:03:50.637170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:03:50.637170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:03:50.637170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:03:50.637170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:03:50.637170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:03:50.637170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:03:50.637170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:50.637170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 436/874] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:03:50.642233 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07872-a85c-4400-8910-3970aadda0ab None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:50.695392 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:50.752885 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07872-a85c-4400-8910-3970aadda0ab None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:50.793373 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcfa53-6653-4e10-9dbd-05cf62ff325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:50.793979 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfa53-6653-4e10-9dbd-05cf62ff325e None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:50.794256 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfa53-6653-4e10-9dbd-05cf62ff325e None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:50.794528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfa53-6653-4e10-9dbd-05cf62ff325e None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:50.795245 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcfa53-6653-4e10-9dbd-05cf62ff325e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:50.795577 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcfa53-6653-4e10-9dbd-05cf62ff325e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:50.797175 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcfa53-6653-4e10-9dbd-05cf62ff325e None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:50.815130 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 439/875] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Aug 18 21:03:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:50.820996 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dc8ec-2423-46f1-b93a-e2eea0dd21b3 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:50.924073 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dc8ec-2423-46f1-b93a-e2eea0dd21b3 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:50.958338 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7db2f3-2c10-45e8-ba90-45b1013a9288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:50.958941 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7db2f3-2c10-45e8-ba90-45b1013a9288 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:50.959223 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7db2f3-2c10-45e8-ba90-45b1013a9288 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:50.959525 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7db2f3-2c10-45e8-ba90-45b1013a9288 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:51.017075 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:51.033459 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7db2f3-2c10-45e8-ba90-45b1013a9288 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:51.035250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7db2f3-2c10-45e8-ba90-45b1013a9288 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:51.144363 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 437/876] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:03:50 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:03:51.151340 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcfa53-6653-4e10-9dbd-05cf62ff325e None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:51.261441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcfa53-6653-4e10-9dbd-05cf62ff325e None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:51.271294 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:51.297606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03adc8d-45d0-4bce-b6a0-60180656369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:51.298232 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03adc8d-45d0-4bce-b6a0-60180656369f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:51.298509 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03adc8d-45d0-4bce-b6a0-60180656369f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:51.298780 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03adc8d-45d0-4bce-b6a0-60180656369f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:51.309491 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03adc8d-45d0-4bce-b6a0-60180656369f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:51.310919 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03adc8d-45d0-4bce-b6a0-60180656369f None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-e03adc8d-45d0-4bce-b6a0-60180656369f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:03:51.327528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:51.328532 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:03:51.329457 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:03:51.329457 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:51.329457 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:51.329457 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 440/877] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:03:51.334464 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7db2f3-2c10-45e8-ba90-45b1013a9288 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:51.435553 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:51.449377 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7db2f3-2c10-45e8-ba90-45b1013a9288 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:51.487448 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b876f21-ced1-4df2-a972-78cf38bb91b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:51.488147 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b876f21-ced1-4df2-a972-78cf38bb91b1 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:51.488338 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b876f21-ced1-4df2-a972-78cf38bb91b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:51.488610 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b876f21-ced1-4df2-a972-78cf38bb91b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:51.489409 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b876f21-ced1-4df2-a972-78cf38bb91b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:51.489621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b876f21-ced1-4df2-a972-78cf38bb91b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:51.490945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b876f21-ced1-4df2-a972-78cf38bb91b1 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:51.503987 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 438/878] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:51.510686 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03adc8d-45d0-4bce-b6a0-60180656369f None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:51.619395 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03adc8d-45d0-4bce-b6a0-60180656369f None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:51.653962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb61699-8939-49af-97f4-3aa24c6e4d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:51.654599 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb61699-8939-49af-97f4-3aa24c6e4d2a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:51.654878 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb61699-8939-49af-97f4-3aa24c6e4d2a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:51.655151 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb61699-8939-49af-97f4-3aa24c6e4d2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:51.662402 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb61699-8939-49af-97f4-3aa24c6e4d2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:51.663901 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb61699-8939-49af-97f4-3aa24c6e4d2a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-dfb61699-8939-49af-97f4-3aa24c6e4d2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:03:51.675954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:51.677094 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:51.678023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:03:51.678023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:03:51.678023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:03:51.678023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:03:51.678023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:03:51.678023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:03:51.678023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:03:51.678023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:51.678023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 441/879] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:03:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:51.683801 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b876f21-ced1-4df2-a972-78cf38bb91b1 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:51.798675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b876f21-ced1-4df2-a972-78cf38bb91b1 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:51.834690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc4467-e652-482d-9431-59ca942b5c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:51.835325 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc4467-e652-482d-9431-59ca942b5c81 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:51.835605 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc4467-e652-482d-9431-59ca942b5c81 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:51.835879 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc4467-e652-482d-9431-59ca942b5c81 None admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:51.836579 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc4467-e652-482d-9431-59ca942b5c81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:51.836926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc4467-e652-482d-9431-59ca942b5c81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:51.838369 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc4467-e652-482d-9431-59ca942b5c81 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:51.851528 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 439/880] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:03:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:03:51.858168 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb61699-8939-49af-97f4-3aa24c6e4d2a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:51.882646 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:51.962180 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb61699-8939-49af-97f4-3aa24c6e4d2a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:51.996285 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d69307-bb5f-4ec5-ab24-ce62153ee04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:51.996881 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d69307-bb5f-4ec5-ab24-ce62153ee04f None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:51.997159 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d69307-bb5f-4ec5-ab24-ce62153ee04f None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:51.997427 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d69307-bb5f-4ec5-ab24-ce62153ee04f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:51.998140 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d69307-bb5f-4ec5-ab24-ce62153ee04f None admin] RBAC: Adding query filter params (role.id=49c7d15532d94cafac420a6bcf8574ad, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=42119f8b3cd5446ea7aca396ad1a0f6d) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:51.998447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d69307-bb5f-4ec5-ab24-ce62153ee04f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:51.999898 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d69307-bb5f-4ec5-ab24-ce62153ee04f None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:52.005294 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 442/881] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:03:51 2022] GET /identity/v3/role_assignments?user.id=42119f8b3cd5446ea7aca396ad1a0f6d&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=49c7d15532d94cafac420a6bcf8574ad => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:54.133299 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcea13a-0876-4c86-94b6-e2424d61d0b0 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:54.133830 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcea13a-0876-4c86-94b6-e2424d61d0b0 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:54.133830 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcea13a-0876-4c86-94b6-e2424d61d0b0 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:54.135203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 440/882] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:54.140970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afba584-6631-4cab-a92d-6d33cbf01008 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:54.141372 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afba584-6631-4cab-a92d-6d33cbf01008 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:54.141568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afba584-6631-4cab-a92d-6d33cbf01008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:54.161426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-2afba584-6631-4cab-a92d-6d33cbf01008 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:54.162629 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-2afba584-6631-4cab-a92d-6d33cbf01008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:54.231545 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 443/883] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:03:54 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:03:54.550819 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcea13a-0876-4c86-94b6-e2424d61d0b0 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:54.561896 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:54.652757 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcea13a-0876-4c86-94b6-e2424d61d0b0 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:54.684896 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eadb03-abd7-43a3-b5b7-7fce1b632a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:54.685510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eadb03-abd7-43a3-b5b7-7fce1b632a4d None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:54.685789 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eadb03-abd7-43a3-b5b7-7fce1b632a4d None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:54.686058 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eadb03-abd7-43a3-b5b7-7fce1b632a4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:54.696624 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eadb03-abd7-43a3-b5b7-7fce1b632a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-66eadb03-abd7-43a3-b5b7-7fce1b632a4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:03:54.701357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:54.702476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:54.703540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:54.703540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:54.703540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:54.703540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:54.703540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:03:54.703540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:03:54.703540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:03:54.703540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:03:54.703540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:03:54.703540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:03:54.703540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:03:54.703540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:54.703540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 441/884] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:54.708422 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afba584-6631-4cab-a92d-6d33cbf01008 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:54.723557 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:54.806912 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afba584-6631-4cab-a92d-6d33cbf01008 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:54.840655 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ffb43-4458-4979-b601-90495224ebde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:54.841246 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ffb43-4458-4979-b601-90495224ebde None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:54.841523 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ffb43-4458-4979-b601-90495224ebde None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:54.841790 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ffb43-4458-4979-b601-90495224ebde None admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:54.842440 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ffb43-4458-4979-b601-90495224ebde None admin] RBAC: Adding query filter params (name=admin) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:54.842742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ffb43-4458-4979-b601-90495224ebde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:54.844132 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ffb43-4458-4979-b601-90495224ebde None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:54.851894 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 444/885] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:54.857639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eadb03-abd7-43a3-b5b7-7fce1b632a4d None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:54.923893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:54.956468 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eadb03-abd7-43a3-b5b7-7fce1b632a4d None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:54.988595 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039966d1-b7bb-45d7-8946-12b4380dbf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:54.989203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039966d1-b7bb-45d7-8946-12b4380dbf93 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:54.989478 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039966d1-b7bb-45d7-8946-12b4380dbf93 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:54.989744 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039966d1-b7bb-45d7-8946-12b4380dbf93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:54.999746 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039966d1-b7bb-45d7-8946-12b4380dbf93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:55.001171 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039966d1-b7bb-45d7-8946-12b4380dbf93 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-039966d1-b7bb-45d7-8946-12b4380dbf93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:03:55.015438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:55.016526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:03:55.017882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:03:55.017882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:55.017882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:55.017882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 442/886] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:55.022294 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ffb43-4458-4979-b601-90495224ebde None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:55.096075 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:55.118684 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ffb43-4458-4979-b601-90495224ebde None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:55.152775 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227251c-a7b4-4d84-8b2c-3d04e90cc243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:55.153398 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227251c-a7b4-4d84-8b2c-3d04e90cc243 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:55.153636 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227251c-a7b4-4d84-8b2c-3d04e90cc243 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:55.153907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227251c-a7b4-4d84-8b2c-3d04e90cc243 None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:55.154541 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227251c-a7b4-4d84-8b2c-3d04e90cc243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:55.154846 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227251c-a7b4-4d84-8b2c-3d04e90cc243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:55.156246 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227251c-a7b4-4d84-8b2c-3d04e90cc243 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:55.168235 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 445/887] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:55.174019 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039966d1-b7bb-45d7-8946-12b4380dbf93 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:55.269601 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039966d1-b7bb-45d7-8946-12b4380dbf93 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:55.287954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:55.301473 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495844b-57dd-480b-ad02-7f2903d22928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:55.302076 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495844b-57dd-480b-ad02-7f2903d22928 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:55.302353 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495844b-57dd-480b-ad02-7f2903d22928 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:55.302623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495844b-57dd-480b-ad02-7f2903d22928 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:55.310189 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495844b-57dd-480b-ad02-7f2903d22928 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:55.311642 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495844b-57dd-480b-ad02-7f2903d22928 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-2495844b-57dd-480b-ad02-7f2903d22928 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:03:55.323060 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:55.324219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:55.325310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:55.325310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:55.325310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:03:55.325310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:03:55.325310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:03:55.325310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:03:55.325310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:03:55.325310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:03:55.325310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:03:55.325310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:55.325310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 443/888] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:55.329911 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227251c-a7b4-4d84-8b2c-3d04e90cc243 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:55.433156 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227251c-a7b4-4d84-8b2c-3d04e90cc243 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:55.465404 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4effed4-bec8-436e-8068-6f7e7078dc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:55.465992 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4effed4-bec8-436e-8068-6f7e7078dc11 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:55.466267 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4effed4-bec8-436e-8068-6f7e7078dc11 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:55.466536 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4effed4-bec8-436e-8068-6f7e7078dc11 None admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:55.467238 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4effed4-bec8-436e-8068-6f7e7078dc11 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:55.467585 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4effed4-bec8-436e-8068-6f7e7078dc11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:55.468997 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4effed4-bec8-436e-8068-6f7e7078dc11 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:55.471448 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:55.485918 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 446/889] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Aug 18 21:03:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:03:55.491558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495844b-57dd-480b-ad02-7f2903d22928 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:55.589473 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495844b-57dd-480b-ad02-7f2903d22928 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:55.623403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85235d61-72cf-48b3-a243-781c7acea707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:55.624017 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85235d61-72cf-48b3-a243-781c7acea707 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:55.624292 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85235d61-72cf-48b3-a243-781c7acea707 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:55.624562 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85235d61-72cf-48b3-a243-781c7acea707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:55.634606 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85235d61-72cf-48b3-a243-781c7acea707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:55.636056 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85235d61-72cf-48b3-a243-781c7acea707 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-85235d61-72cf-48b3-a243-781c7acea707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:03:55.649456 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:55.650598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:03:55.651619 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:03:55.651619 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:55.651619 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:55.651619 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 444/890] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:55.656156 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4effed4-bec8-436e-8068-6f7e7078dc11 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:55.752429 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4effed4-bec8-436e-8068-6f7e7078dc11 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:55.785358 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283183cd-af8e-4ad1-b3db-b293651bd51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:55.785953 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283183cd-af8e-4ad1-b3db-b293651bd51a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:55.786236 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283183cd-af8e-4ad1-b3db-b293651bd51a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:55.786510 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283183cd-af8e-4ad1-b3db-b293651bd51a None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:55.787142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283183cd-af8e-4ad1-b3db-b293651bd51a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:55.787479 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283183cd-af8e-4ad1-b3db-b293651bd51a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:55.788845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283183cd-af8e-4ad1-b3db-b293651bd51a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:55.800261 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 447/891] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:55.805906 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85235d61-72cf-48b3-a243-781c7acea707 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:55.837103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:55.904001 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85235d61-72cf-48b3-a243-781c7acea707 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:55.936509 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69cbd9-54ee-4cd4-b7d3-083afa656cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:55.937114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69cbd9-54ee-4cd4-b7d3-083afa656cb5 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:55.937394 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69cbd9-54ee-4cd4-b7d3-083afa656cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:55.937664 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69cbd9-54ee-4cd4-b7d3-083afa656cb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:55.944200 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69cbd9-54ee-4cd4-b7d3-083afa656cb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:55.945647 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69cbd9-54ee-4cd4-b7d3-083afa656cb5 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-bf69cbd9-54ee-4cd4-b7d3-083afa656cb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:03:55.956385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:55.957440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:55.958558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:03:55.958558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:03:55.958558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:03:55.958558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:03:55.958558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:03:55.958558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:03:55.958558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:03:55.958558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:03:55.966470 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 445/892] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:03:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:55.972482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283183cd-af8e-4ad1-b3db-b293651bd51a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:56.026829 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:56.072766 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283183cd-af8e-4ad1-b3db-b293651bd51a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:56.105579 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc70d36-74db-4f7c-86fd-e3dd688ec109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:56.106168 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc70d36-74db-4f7c-86fd-e3dd688ec109 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:56.106451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc70d36-74db-4f7c-86fd-e3dd688ec109 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:56.106727 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc70d36-74db-4f7c-86fd-e3dd688ec109 None admin] PATH_INFO: `/v3/projects` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:56.107432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc70d36-74db-4f7c-86fd-e3dd688ec109 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:56.107743 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc70d36-74db-4f7c-86fd-e3dd688ec109 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:56.109162 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc70d36-74db-4f7c-86fd-e3dd688ec109 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:56.120771 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 448/893] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:03:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:56.127057 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69cbd9-54ee-4cd4-b7d3-083afa656cb5 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:56.220147 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:56.228845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69cbd9-54ee-4cd4-b7d3-083afa656cb5 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:56.260667 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fb004-8bb9-4425-8150-fad736623137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:56.261308 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fb004-8bb9-4425-8150-fad736623137 None admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:56.261587 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fb004-8bb9-4425-8150-fad736623137 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:56.261858 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fb004-8bb9-4425-8150-fad736623137 None admin] PATH_INFO: `/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/42119f8b3cd5446ea7aca396ad1a0f6d/roles/49c7d15532d94cafac420a6bcf8574ad` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:56.263776 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fb004-8bb9-4425-8150-fad736623137 None admin] RBAC: Authorizing `identity:create_grant(project_id=55812d15e0dc4e75bb9a31abfa3387bf, user_id=42119f8b3cd5446ea7aca396ad1a0f6d, role_id=49c7d15532d94cafac420a6bcf8574ad)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:56.265196 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fb004-8bb9-4425-8150-fad736623137 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:56.277589 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 446/894] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Aug 18 21:03:56 2022] PUT /identity/v3/projects/55812d15e0dc4e75bb9a31abfa3387bf/users/42119f8b3cd5446ea7aca396ad1a0f6d/roles/49c7d15532d94cafac420a6bcf8574ad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:03:58.412019 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12e7c3-76b5-4388-89cc-6f9f697dc999 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:58.412541 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12e7c3-76b5-4388-89cc-6f9f697dc999 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:58.412541 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12e7c3-76b5-4388-89cc-6f9f697dc999 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:58.413886 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 449/895] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:58.419186 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a110a-129e-40e1-86ed-1a074ed05981 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:58.419637 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a110a-129e-40e1-86ed-1a074ed05981 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:58.419781 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a110a-129e-40e1-86ed-1a074ed05981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:58.437297 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-765a110a-129e-40e1-86ed-1a074ed05981 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:58.438745 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-765a110a-129e-40e1-86ed-1a074ed05981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:58.503347 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 447/896] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:03:58 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:03:58.830111 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12e7c3-76b5-4388-89cc-6f9f697dc999 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:58.927885 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12e7c3-76b5-4388-89cc-6f9f697dc999 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:58.941816 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:58.961586 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdff404-5ff9-40b8-979e-ca12574687ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:58.962192 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdff404-5ff9-40b8-979e-ca12574687ef None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:58.962467 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdff404-5ff9-40b8-979e-ca12574687ef None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:58.962734 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdff404-5ff9-40b8-979e-ca12574687ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:58.972304 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdff404-5ff9-40b8-979e-ca12574687ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-2fdff404-5ff9-40b8-979e-ca12574687ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:03:58.976936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:58.978045 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:58.978887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:58.978887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:58.978887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:58.978887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:58.978887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:03:58.978887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:03:58.978887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:03:58.978887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:03:58.978887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:03:58.978887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:03:58.978887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:03:58.978887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:58.978887 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 450/897] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Aug 18 21:03:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:58.983961 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a110a-129e-40e1-86ed-1a074ed05981 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:59.061941 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:59.081310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a110a-129e-40e1-86ed-1a074ed05981 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:59.114564 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6260c2-49cc-466a-a1b2-5ff86554dc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:59.115170 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6260c2-49cc-466a-a1b2-5ff86554dc4e None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:59.115481 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6260c2-49cc-466a-a1b2-5ff86554dc4e None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:59.115756 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6260c2-49cc-466a-a1b2-5ff86554dc4e None admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:59.116420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6260c2-49cc-466a-a1b2-5ff86554dc4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:59.116721 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6260c2-49cc-466a-a1b2-5ff86554dc4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:59.118804 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6260c2-49cc-466a-a1b2-5ff86554dc4e None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:59.127174 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 448/898] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Aug 18 21:03:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:59.134030 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdff404-5ff9-40b8-979e-ca12574687ef None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:59.233630 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdff404-5ff9-40b8-979e-ca12574687ef None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:59.265971 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dbb03-4ae9-4cc3-afc0-ef2e7a828f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:59.266582 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dbb03-4ae9-4cc3-afc0-ef2e7a828f0a None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:59.266861 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dbb03-4ae9-4cc3-afc0-ef2e7a828f0a None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:59.267131 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dbb03-4ae9-4cc3-afc0-ef2e7a828f0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:59.276645 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741dbb03-4ae9-4cc3-afc0-ef2e7a828f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:59.278082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741dbb03-4ae9-4cc3-afc0-ef2e7a828f0a None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-741dbb03-4ae9-4cc3-afc0-ef2e7a828f0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:03:59.292394 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:59.293451 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:03:59.294375 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:03:59.294375 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:03:59.294375 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:59.294375 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 451/899] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:59.299300 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6260c2-49cc-466a-a1b2-5ff86554dc4e None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:59.397772 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6260c2-49cc-466a-a1b2-5ff86554dc4e None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:59.430605 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae935d-df48-4df6-a9cb-c9e2cc4b7ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:59.431197 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae935d-df48-4df6-a9cb-c9e2cc4b7ae3 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:59.431504 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae935d-df48-4df6-a9cb-c9e2cc4b7ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:59.431773 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae935d-df48-4df6-a9cb-c9e2cc4b7ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:59.432402 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae935d-df48-4df6-a9cb-c9e2cc4b7ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:59.432701 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae935d-df48-4df6-a9cb-c9e2cc4b7ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:59.434063 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae935d-df48-4df6-a9cb-c9e2cc4b7ae3 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:59.446097 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 449/900] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:59.451919 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dbb03-4ae9-4cc3-afc0-ef2e7a828f0a None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:59.480272 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:59.550500 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dbb03-4ae9-4cc3-afc0-ef2e7a828f0a None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:59.584096 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe2230-edca-4f13-b239-cec841574438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:59.584710 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe2230-edca-4f13-b239-cec841574438 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:59.584990 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe2230-edca-4f13-b239-cec841574438 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:59.585263 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe2230-edca-4f13-b239-cec841574438 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:59.593089 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe2230-edca-4f13-b239-cec841574438 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:59.594514 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe2230-edca-4f13-b239-cec841574438 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-4dfe2230-edca-4f13-b239-cec841574438 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:03:59.607524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:03:59.608620 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:03:59.609982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:03:59.609982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:03:59.609982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:03:59.609982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:03:59.609982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:03:59.609982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:03:59.609982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:03:59.609982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:03:59.609982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:03:59.609982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:03:59.609982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 452/901] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:03:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:03:59.614383 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae935d-df48-4df6-a9cb-c9e2cc4b7ae3 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:59.618103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:59.711919 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae935d-df48-4df6-a9cb-c9e2cc4b7ae3 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:59.745206 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d3aaf-ffc4-4c41-98d0-b12e506675c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:59.745798 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d3aaf-ffc4-4c41-98d0-b12e506675c4 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:59.746078 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d3aaf-ffc4-4c41-98d0-b12e506675c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:59.746349 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d3aaf-ffc4-4c41-98d0-b12e506675c4 None admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:59.747066 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d3aaf-ffc4-4c41-98d0-b12e506675c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:03:59.747400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d3aaf-ffc4-4c41-98d0-b12e506675c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:59.748819 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d3aaf-ffc4-4c41-98d0-b12e506675c4 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:59.765248 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 450/902] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Aug 18 21:03:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:59.770986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe2230-edca-4f13-b239-cec841574438 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:59.855714 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:59.870744 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe2230-edca-4f13-b239-cec841574438 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:59.904315 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce7434-554b-450e-9e3b-21aa5a0c8113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:59.905410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce7434-554b-450e-9e3b-21aa5a0c8113 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:59.905690 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce7434-554b-450e-9e3b-21aa5a0c8113 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:59.905964 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce7434-554b-450e-9e3b-21aa5a0c8113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:59.969939 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce7434-554b-450e-9e3b-21aa5a0c8113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:59.971331 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce7434-554b-450e-9e3b-21aa5a0c8113 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:00.050039 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:00.066312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 453/903] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Aug 18 21:03:59 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:04:00.072144 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d3aaf-ffc4-4c41-98d0-b12e506675c4 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:00.133896 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:00.172390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d3aaf-ffc4-4c41-98d0-b12e506675c4 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:00.205564 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48142679-aa26-420e-af71-640414fc0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:00.206187 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48142679-aa26-420e-af71-640414fc0896 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:00.206468 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48142679-aa26-420e-af71-640414fc0896 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:00.206740 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48142679-aa26-420e-af71-640414fc0896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:00.217017 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48142679-aa26-420e-af71-640414fc0896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:00.218464 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48142679-aa26-420e-af71-640414fc0896 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-48142679-aa26-420e-af71-640414fc0896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:04:00.233234 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:04:00.234334 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:04:00.235809 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:04:00.235809 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:04:00.235809 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:04:00.235809 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 451/904] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:04:00.240037 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce7434-554b-450e-9e3b-21aa5a0c8113 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:00.335187 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce7434-554b-450e-9e3b-21aa5a0c8113 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:00.370072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cba81-b633-4b0f-8c3a-1612783d919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:00.370666 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cba81-b633-4b0f-8c3a-1612783d919c None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:00.370945 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cba81-b633-4b0f-8c3a-1612783d919c None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:00.371217 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cba81-b633-4b0f-8c3a-1612783d919c None admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:00.371876 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cba81-b633-4b0f-8c3a-1612783d919c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:04:00.372179 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cba81-b633-4b0f-8c3a-1612783d919c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:00.373538 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cba81-b633-4b0f-8c3a-1612783d919c None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:00.385259 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 454/905] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Aug 18 21:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:04:00.390883 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48142679-aa26-420e-af71-640414fc0896 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:00.487464 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48142679-aa26-420e-af71-640414fc0896 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:00.500208 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:00.520181 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110c0a5-5708-4e85-93d0-37d51db6cf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:00.520793 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110c0a5-5708-4e85-93d0-37d51db6cf8f None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:00.521070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110c0a5-5708-4e85-93d0-37d51db6cf8f None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:00.521339 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110c0a5-5708-4e85-93d0-37d51db6cf8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:00.528868 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110c0a5-5708-4e85-93d0-37d51db6cf8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:00.530283 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110c0a5-5708-4e85-93d0-37d51db6cf8f None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application [None req-7110c0a5-5708-4e85-93d0-37d51db6cf8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:04:00.541602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application with Lock( Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:04:00.542651 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:04:00.543915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:04:00.543915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:04:00.543915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:04:00.543915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:04:00.543915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:04:00.543915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:04:00.543915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:04:00.543915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: ERROR keystone.server.flask.application Aug 18 21:04:00.543915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 452/906] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Aug 18 21:04:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:04:00.548458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cba81-b633-4b0f-8c3a-1612783d919c None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:00.594529 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:00.645583 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cba81-b633-4b0f-8c3a-1612783d919c None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:00.677373 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986f39c-c0a5-4bee-a320-b43da97ba429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:00.677967 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986f39c-c0a5-4bee-a320-b43da97ba429 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:00.678241 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986f39c-c0a5-4bee-a320-b43da97ba429 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:00.678512 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986f39c-c0a5-4bee-a320-b43da97ba429 None admin] PATH_INFO: `/v3/projects` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:00.679183 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986f39c-c0a5-4bee-a320-b43da97ba429 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:04:00.679517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986f39c-c0a5-4bee-a320-b43da97ba429 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:00.680976 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986f39c-c0a5-4bee-a320-b43da97ba429 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:00.692483 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 455/907] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Aug 18 21:04:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:04:00.699017 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110c0a5-5708-4e85-93d0-37d51db6cf8f None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:00.796476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110c0a5-5708-4e85-93d0-37d51db6cf8f None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:00.829150 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb88c59-bb3b-4313-b90a-89f88f5b51d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:00.829740 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb88c59-bb3b-4313-b90a-89f88f5b51d4 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:00.830021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb88c59-bb3b-4313-b90a-89f88f5b51d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:00.830293 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb88c59-bb3b-4313-b90a-89f88f5b51d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:00.831007 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb88c59-bb3b-4313-b90a-89f88f5b51d4 None admin] RBAC: Adding query filter params (role.id=49c7d15532d94cafac420a6bcf8574ad, scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf, user.id=42119f8b3cd5446ea7aca396ad1a0f6d) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:04:00.831342 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb88c59-bb3b-4313-b90a-89f88f5b51d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:00.832758 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb88c59-bb3b-4313-b90a-89f88f5b51d4 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:00.838882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 453/908] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Aug 18 21:04:00 2022] GET /identity/v3/role_assignments?user.id=42119f8b3cd5446ea7aca396ad1a0f6d&scope.project.id=55812d15e0dc4e75bb9a31abfa3387bf&role.id=49c7d15532d94cafac420a6bcf8574ad => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:04:03.013683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4821a-8dc6-4eee-8e98-42259f048d31 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:03.014182 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4821a-8dc6-4eee-8e98-42259f048d31 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:03.014182 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4821a-8dc6-4eee-8e98-42259f048d31 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:03.015489 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 456/909] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:03.020514 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626142-6090-40a4-8763-75d68388e04a None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:03.020882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626142-6090-40a4-8763-75d68388e04a None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:03.021063 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626142-6090-40a4-8763-75d68388e04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:03.039374 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-32626142-6090-40a4-8763-75d68388e04a None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:03.040550 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-32626142-6090-40a4-8763-75d68388e04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:03.069198 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:03.106337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 454/910] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:04:03 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:04:03.436596 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4821a-8dc6-4eee-8e98-42259f048d31 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:03.536260 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4821a-8dc6-4eee-8e98-42259f048d31 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:03.545135 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:03.576431 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7fdfd-36e4-4424-9264-8f5b488f7288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:03.577065 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7fdfd-36e4-4424-9264-8f5b488f7288 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:03.577340 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7fdfd-36e4-4424-9264-8f5b488f7288 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:03.577613 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7fdfd-36e4-4424-9264-8f5b488f7288 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:03.578195 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7fdfd-36e4-4424-9264-8f5b488f7288 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:03.579614 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7fdfd-36e4-4424-9264-8f5b488f7288 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-4bf7fdfd-36e4-4424-9264-8f5b488f7288 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:04:03.588819 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:04:03.591527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:04:03.592616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 457/911] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Aug 18 21:04:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:04:03.596047 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32626142-6090-40a4-8763-75d68388e04a None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:03.703986 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32626142-6090-40a4-8763-75d68388e04a None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:03.744821 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc36ae2-ddeb-421c-b0e8-cd575b7ffed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:03.745423 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc36ae2-ddeb-421c-b0e8-cd575b7ffed5 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:03.745699 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc36ae2-ddeb-421c-b0e8-cd575b7ffed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:03.745968 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc36ae2-ddeb-421c-b0e8-cd575b7ffed5 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:03.746596 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc36ae2-ddeb-421c-b0e8-cd575b7ffed5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:04:03.746894 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc36ae2-ddeb-421c-b0e8-cd575b7ffed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:03.748289 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc36ae2-ddeb-421c-b0e8-cd575b7ffed5 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:03.753165 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 455/912] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Aug 18 21:04:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:04:03.758979 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7fdfd-36e4-4424-9264-8f5b488f7288 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:03.862019 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7fdfd-36e4-4424-9264-8f5b488f7288 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:03.895548 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe59b5-f382-44e4-be38-2874fe9f6318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:03.896144 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe59b5-f382-44e4-be38-2874fe9f6318 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:03.896445 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe59b5-f382-44e4-be38-2874fe9f6318 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:03.896703 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe59b5-f382-44e4-be38-2874fe9f6318 None admin] PATH_INFO: `/v3/services` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:03.897322 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe59b5-f382-44e4-be38-2874fe9f6318 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:04:03.897627 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe59b5-f382-44e4-be38-2874fe9f6318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:03.899014 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe59b5-f382-44e4-be38-2874fe9f6318 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:03.903634 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 458/913] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Aug 18 21:04:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:04:06.066647 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8dda6-5209-41db-b17e-6e04f945f950 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:06.067204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8dda6-5209-41db-b17e-6e04f945f950 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:06.067204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8dda6-5209-41db-b17e-6e04f945f950 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:06.068558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 456/914] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:06.073672 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ba460-4a6b-4bb1-8444-e4eb10629cb7 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:06.074080 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ba460-4a6b-4bb1-8444-e4eb10629cb7 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:06.074214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ba460-4a6b-4bb1-8444-e4eb10629cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:06.091725 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-747ba460-4a6b-4bb1-8444-e4eb10629cb7 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:06.092889 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-747ba460-4a6b-4bb1-8444-e4eb10629cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:06.120864 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:06.168321 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 459/915] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:04:06 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:04:06.493949 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8dda6-5209-41db-b17e-6e04f945f950 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:06.525956 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:06.598097 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8dda6-5209-41db-b17e-6e04f945f950 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:06.631231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1b868-c269-48ce-98a5-b1b78ba3e480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:06.631850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1b868-c269-48ce-98a5-b1b78ba3e480 None admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:06.632129 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1b868-c269-48ce-98a5-b1b78ba3e480 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:06.632900 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1b868-c269-48ce-98a5-b1b78ba3e480 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:06.633530 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1b868-c269-48ce-98a5-b1b78ba3e480 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:06.634887 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1b868-c269-48ce-98a5-b1b78ba3e480 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:06.650435 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 457/916] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Aug 18 21:04:06 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:04:08.828826 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da4c1a-9fd6-4a67-8942-1d953015fbab None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:08.829344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da4c1a-9fd6-4a67-8942-1d953015fbab None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:08.829344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da4c1a-9fd6-4a67-8942-1d953015fbab None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:08.830711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 460/917] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:08.836365 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f7c1-0724-4d6b-b256-3df23360b0d1 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:08.837251 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f7c1-0724-4d6b-b256-3df23360b0d1 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:08.837540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f7c1-0724-4d6b-b256-3df23360b0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:08.855446 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-cb61f7c1-0724-4d6b-b256-3df23360b0d1 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:08.856565 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-cb61f7c1-0724-4d6b-b256-3df23360b0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:08.926954 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 458/918] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:04:08 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:04:09.263649 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da4c1a-9fd6-4a67-8942-1d953015fbab None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:09.360978 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da4c1a-9fd6-4a67-8942-1d953015fbab None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:09.396587 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ccd8b-a971-47e0-ac7e-c9f028c926c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:09.397200 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ccd8b-a971-47e0-ac7e-c9f028c926c8 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:09.397476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ccd8b-a971-47e0-ac7e-c9f028c926c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:09.397807 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ccd8b-a971-47e0-ac7e-c9f028c926c8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:09.398373 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ccd8b-a971-47e0-ac7e-c9f028c926c8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:09.399767 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ccd8b-a971-47e0-ac7e-c9f028c926c8 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-c87ccd8b-a971-47e0-ac7e-c9f028c926c8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:04:09.408129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:04:09.409302 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:04:09.410153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 461/919] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Aug 18 21:04:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:04:09.415304 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61f7c1-0724-4d6b-b256-3df23360b0d1 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:09.433557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:09.512005 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61f7c1-0724-4d6b-b256-3df23360b0d1 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:09.544171 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696087f0-84d7-4e6b-b885-195f76127b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:09.544765 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696087f0-84d7-4e6b-b885-195f76127b63 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:09.545042 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696087f0-84d7-4e6b-b885-195f76127b63 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:09.545308 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696087f0-84d7-4e6b-b885-195f76127b63 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:09.545918 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696087f0-84d7-4e6b-b885-195f76127b63 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:04:09.546212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696087f0-84d7-4e6b-b885-195f76127b63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:09.547589 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696087f0-84d7-4e6b-b885-195f76127b63 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:09.552442 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 459/920] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Aug 18 21:04:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:04:09.559083 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ccd8b-a971-47e0-ac7e-c9f028c926c8 None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:09.588850 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:09.661405 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ccd8b-a971-47e0-ac7e-c9f028c926c8 None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:09.696344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243c72e-36d7-45c8-8e5c-2fc44a187609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:09.696928 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243c72e-36d7-45c8-8e5c-2fc44a187609 None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:09.697206 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243c72e-36d7-45c8-8e5c-2fc44a187609 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:09.697474 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243c72e-36d7-45c8-8e5c-2fc44a187609 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:09.698155 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243c72e-36d7-45c8-8e5c-2fc44a187609 None admin] RBAC: Adding query filter params (interface=public, service_id=edd14a0cbdfd4037b5705929b2dcbe37, region_id=RegionOne) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:04:09.698457 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243c72e-36d7-45c8-8e5c-2fc44a187609 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:09.699851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243c72e-36d7-45c8-8e5c-2fc44a187609 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:09.704619 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 462/921] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Aug 18 21:04:09 2022] GET /identity/v3/endpoints?service_id=edd14a0cbdfd4037b5705929b2dcbe37&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:04:09.710435 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696087f0-84d7-4e6b-b885-195f76127b63 None admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:09.790357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:09.809391 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696087f0-84d7-4e6b-b885-195f76127b63 None admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:09.842599 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08002ce1-a075-4213-9a90-a8797c381ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:09.843192 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002ce1-a075-4213-9a90-a8797c381ae2 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:09.843500 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002ce1-a075-4213-9a90-a8797c381ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:09.843770 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002ce1-a075-4213-9a90-a8797c381ae2 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:09.844364 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08002ce1-a075-4213-9a90-a8797c381ae2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:09.845723 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08002ce1-a075-4213-9a90-a8797c381ae2 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:09.852558 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 460/922] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Aug 18 21:04:09 2022] GET /identity/v3/services => generated 1962 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:04:12.058171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f448d28-45dc-4ca3-a45b-12c15c31d796 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:12.058760 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f448d28-45dc-4ca3-a45b-12c15c31d796 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:12.058760 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f448d28-45dc-4ca3-a45b-12c15c31d796 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:12.060107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 463/923] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:12.065759 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9037e-4dcd-4cd7-b7d8-86e015616b25 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:12.066206 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9037e-4dcd-4cd7-b7d8-86e015616b25 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:12.066300 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9037e-4dcd-4cd7-b7d8-86e015616b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:12.084302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-d0e9037e-4dcd-4cd7-b7d8-86e015616b25 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:12.085576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-d0e9037e-4dcd-4cd7-b7d8-86e015616b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:12.154685 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 461/924] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:04:12 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:04:12.478259 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f448d28-45dc-4ca3-a45b-12c15c31d796 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:12.574666 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:12.584658 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f448d28-45dc-4ca3-a45b-12c15c31d796 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:12.620311 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce347a98-f296-4932-9764-885ec26f314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:12.620969 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce347a98-f296-4932-9764-885ec26f314d None admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:12.621208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce347a98-f296-4932-9764-885ec26f314d None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:12.621482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce347a98-f296-4932-9764-885ec26f314d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:12.622078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce347a98-f296-4932-9764-885ec26f314d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:12.623599 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce347a98-f296-4932-9764-885ec26f314d None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application [None req-ce347a98-f296-4932-9764-885ec26f314d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:04:12.633662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:04:12.634863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application with Lock( Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: ERROR keystone.server.flask.application Aug 18 21:04:12.635908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 464/925] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Aug 18 21:04:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:04:12.641709 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9037e-4dcd-4cd7-b7d8-86e015616b25 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:12.716998 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:12.744552 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9037e-4dcd-4cd7-b7d8-86e015616b25 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:12.782495 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8a3ea-22e5-435c-82da-2d685b5bdac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:12.783100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8a3ea-22e5-435c-82da-2d685b5bdac8 None admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:12.783417 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8a3ea-22e5-435c-82da-2d685b5bdac8 None admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:12.783687 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8a3ea-22e5-435c-82da-2d685b5bdac8 None admin] PATH_INFO: `/v3/services` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:12.784321 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8a3ea-22e5-435c-82da-2d685b5bdac8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:04:12.784614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8a3ea-22e5-435c-82da-2d685b5bdac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:12.785980 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8a3ea-22e5-435c-82da-2d685b5bdac8 None admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:12.791131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 462/926] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Aug 18 21:04:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:04:12.797078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce347a98-f296-4932-9764-885ec26f314d None admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:12.897990 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce347a98-f296-4932-9764-885ec26f314d None admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:12.929986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793baec-70be-4bca-8637-8bf8f64ef9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:12.930567 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793baec-70be-4bca-8637-8bf8f64ef9f0 None admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:12.930841 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793baec-70be-4bca-8637-8bf8f64ef9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:12.931109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793baec-70be-4bca-8637-8bf8f64ef9f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:12.931782 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793baec-70be-4bca-8637-8bf8f64ef9f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:12.933138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793baec-70be-4bca-8637-8bf8f64ef9f0 None admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:12.953738 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 465/927] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Aug 18 21:04:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:04:22.788186 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=30 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:22.949703 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:13.274126 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d43610-9e40-45dc-84d3-ff0e62831bda None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:13.274672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d43610-9e40-45dc-84d3-ff0e62831bda None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:13.274672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d43610-9e40-45dc-84d3-ff0e62831bda None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:13.276188 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 463/928] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:13.281642 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a9750-99cd-4f3e-b62e-f7f2968c9d50 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:13.282497 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a9750-99cd-4f3e-b62e-f7f2968c9d50 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:13.283043 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a9750-99cd-4f3e-b62e-f7f2968c9d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:13.304967 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-ca6a9750-99cd-4f3e-b62e-f7f2968c9d50 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:13.306539 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-ca6a9750-99cd-4f3e-b62e-f7f2968c9d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:13.391540 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 466/929] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:13.746090 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65b4a7-c49c-403c-9763-5ed6a87f1a1a None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:13.746460 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65b4a7-c49c-403c-9763-5ed6a87f1a1a None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:13.746638 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65b4a7-c49c-403c-9763-5ed6a87f1a1a None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:13.748290 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 464/930] 10.222.0.16 () {54 vars in 965 bytes} [Thu Aug 18 21:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:13.757791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9db19-9d9a-4dfa-b71c-e7b254aeb257 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:13.757791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9db19-9d9a-4dfa-b71c-e7b254aeb257 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:13.757791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9db19-9d9a-4dfa-b71c-e7b254aeb257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:13.861459 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-79a9db19-9d9a-4dfa-b71c-e7b254aeb257 None None] MFA Rules not processed for user `b9326ebc83a2471a856f668ee77285c5`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:13.862720 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-79a9db19-9d9a-4dfa-b71c-e7b254aeb257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:13.927807 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 467/931] 10.222.0.16 () {58 vars in 1062 bytes} [Thu Aug 18 21:05:13 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:13.936682 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65b4a7-c49c-403c-9763-5ed6a87f1a1a None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:13.947734 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65b4a7-c49c-403c-9763-5ed6a87f1a1a None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:13.952111 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffe421-190d-46fd-99bd-137de1ff611e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:13.952708 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffe421-190d-46fd-99bd-137de1ff611e service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:13.952991 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffe421-190d-46fd-99bd-137de1ff611e service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:13.953261 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffe421-190d-46fd-99bd-137de1ff611e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:13.962955 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffe421-190d-46fd-99bd-137de1ff611e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:13.964460 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffe421-190d-46fd-99bd-137de1ff611e service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:13.975383 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 465/932] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:16.467827 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c0167-fc9e-4e4b-a50c-f30f05fa0961 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:16.468364 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c0167-fc9e-4e4b-a50c-f30f05fa0961 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:16.468364 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c0167-fc9e-4e4b-a50c-f30f05fa0961 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:16.470050 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 468/933] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:16.475831 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b943ae9-8cf6-4213-ac93-a9186bbeddf3 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:16.476316 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b943ae9-8cf6-4213-ac93-a9186bbeddf3 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:16.476392 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b943ae9-8cf6-4213-ac93-a9186bbeddf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:16.497580 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-2b943ae9-8cf6-4213-ac93-a9186bbeddf3 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:16.498791 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-2b943ae9-8cf6-4213-ac93-a9186bbeddf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:16.507431 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 466/934] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:16.851825 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c0167-fc9e-4e4b-a50c-f30f05fa0961 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:16.863893 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c0167-fc9e-4e4b-a50c-f30f05fa0961 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:16.868366 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf103d-10fe-44a6-aad9-38f2848c7afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:16.869843 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf103d-10fe-44a6-aad9-38f2848c7afd service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:16.870127 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf103d-10fe-44a6-aad9-38f2848c7afd service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:16.870396 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf103d-10fe-44a6-aad9-38f2848c7afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:16.881157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf103d-10fe-44a6-aad9-38f2848c7afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:16.882794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf103d-10fe-44a6-aad9-38f2848c7afd service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:16.893782 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 469/935] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:19.393141 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15ca5f-f210-475a-9dd0-066385b6b5b7 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:19.393673 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15ca5f-f210-475a-9dd0-066385b6b5b7 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:19.393787 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15ca5f-f210-475a-9dd0-066385b6b5b7 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:19.395215 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 467/936] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:19.401082 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9729a-e8e8-40ed-91d5-b25475195b1e None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:19.401498 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9729a-e8e8-40ed-91d5-b25475195b1e None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:19.401782 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9729a-e8e8-40ed-91d5-b25475195b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:19.438349 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-04f9729a-e8e8-40ed-91d5-b25475195b1e None None] MFA Rules not processed for user `045909bc53cf41cc804f18ddc4d94d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:19.439568 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-04f9729a-e8e8-40ed-91d5-b25475195b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:19.479035 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:19.506343 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 470/937] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:19 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:19.847713 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15ca5f-f210-475a-9dd0-066385b6b5b7 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:19.858997 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15ca5f-f210-475a-9dd0-066385b6b5b7 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:19.862434 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d482bc5-9cb9-4139-989d-0c32f5cbdbbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:19.863023 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d482bc5-9cb9-4139-989d-0c32f5cbdbbb service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:19.863332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d482bc5-9cb9-4139-989d-0c32f5cbdbbb service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:19.863613 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d482bc5-9cb9-4139-989d-0c32f5cbdbbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:19.872870 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d482bc5-9cb9-4139-989d-0c32f5cbdbbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:19.874307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d482bc5-9cb9-4139-989d-0c32f5cbdbbb service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:19.883533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 468/938] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:19 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:22.640344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62245a9e-8b77-445b-a172-7b7397ca166e None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:22.640794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62245a9e-8b77-445b-a172-7b7397ca166e None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:22.640913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62245a9e-8b77-445b-a172-7b7397ca166e None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:22.642198 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 471/939] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:22.647271 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba9978-71b9-4355-a15d-c4c70c9cb2e3 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:22.647701 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba9978-71b9-4355-a15d-c4c70c9cb2e3 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:22.647810 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba9978-71b9-4355-a15d-c4c70c9cb2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:22.666044 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-24ba9978-71b9-4355-a15d-c4c70c9cb2e3 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:22.667221 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-24ba9978-71b9-4355-a15d-c4c70c9cb2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:22.734053 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 469/940] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:22 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:23.071178 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62245a9e-8b77-445b-a172-7b7397ca166e None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:23.081856 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62245a9e-8b77-445b-a172-7b7397ca166e None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:23.085827 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fb92d-7dfa-4016-8e5b-ea83cc1c8722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:23.086419 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fb92d-7dfa-4016-8e5b-ea83cc1c8722 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:23.086696 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fb92d-7dfa-4016-8e5b-ea83cc1c8722 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:23.086966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fb92d-7dfa-4016-8e5b-ea83cc1c8722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:23.095556 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fb92d-7dfa-4016-8e5b-ea83cc1c8722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:23.096987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fb92d-7dfa-4016-8e5b-ea83cc1c8722 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:23.107141 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 472/941] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:23 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:25.916331 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7ea2f-1c43-4749-b63a-652ecf5ae37b None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:25.916832 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7ea2f-1c43-4749-b63a-652ecf5ae37b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:25.916832 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7ea2f-1c43-4749-b63a-652ecf5ae37b None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:25.918124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 470/942] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:25.923970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a89de-281a-45f9-9a5a-9236fe9f5fe7 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:25.924428 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a89de-281a-45f9-9a5a-9236fe9f5fe7 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:25.924519 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a89de-281a-45f9-9a5a-9236fe9f5fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:25.943562 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-077a89de-281a-45f9-9a5a-9236fe9f5fe7 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:25.944755 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-077a89de-281a-45f9-9a5a-9236fe9f5fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:25.952901 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 473/943] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:26.290655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7ea2f-1c43-4749-b63a-652ecf5ae37b None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:26.301120 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7ea2f-1c43-4749-b63a-652ecf5ae37b None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:26.304646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ff960-3947-40e2-8de5-18b9533aae27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:26.305734 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff960-3947-40e2-8de5-18b9533aae27 service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:26.306014 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff960-3947-40e2-8de5-18b9533aae27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:26.306286 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff960-3947-40e2-8de5-18b9533aae27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:26.314980 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff960-3947-40e2-8de5-18b9533aae27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:26.316436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff960-3947-40e2-8de5-18b9533aae27 service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:26.326215 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 471/944] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:28.563745 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0bb15-4188-42f2-ac65-c782a7aaa79e None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.564312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0bb15-4188-42f2-ac65-c782a7aaa79e None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.564312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0bb15-4188-42f2-ac65-c782a7aaa79e None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.565610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 474/945] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:28.570634 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bd276-2e31-4c6a-a92b-08a1643ca75a None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.571136 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bd276-2e31-4c6a-a92b-08a1643ca75a None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.571891 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bd276-2e31-4c6a-a92b-08a1643ca75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.591391 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-ee0bd276-2e31-4c6a-a92b-08a1643ca75a None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:28.592584 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-ee0bd276-2e31-4c6a-a92b-08a1643ca75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:28.600459 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 472/946] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:28.941756 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0bb15-4188-42f2-ac65-c782a7aaa79e None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:28.952719 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0bb15-4188-42f2-ac65-c782a7aaa79e None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:28.956387 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd363e1a-bbe0-4279-b2a6-3c3c91087339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:28.956970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd363e1a-bbe0-4279-b2a6-3c3c91087339 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.957246 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd363e1a-bbe0-4279-b2a6-3c3c91087339 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.957510 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd363e1a-bbe0-4279-b2a6-3c3c91087339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.967050 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd363e1a-bbe0-4279-b2a6-3c3c91087339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:28.968509 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd363e1a-bbe0-4279-b2a6-3c3c91087339 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:28.977963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 475/947] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:31.201226 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac3b7c-b0de-4df9-bd92-43a97ab6b68b None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.201748 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac3b7c-b0de-4df9-bd92-43a97ab6b68b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.201836 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac3b7c-b0de-4df9-bd92-43a97ab6b68b None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.203114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 473/948] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:31.208592 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377db25-61b3-4416-b0be-47615905a23f None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.209001 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377db25-61b3-4416-b0be-47615905a23f None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.209144 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377db25-61b3-4416-b0be-47615905a23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.228748 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-0377db25-61b3-4416-b0be-47615905a23f None None] MFA Rules not processed for user `045909bc53cf41cc804f18ddc4d94d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:31.229980 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-0377db25-61b3-4416-b0be-47615905a23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:31.237762 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 476/949] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:31 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:31.579599 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac3b7c-b0de-4df9-bd92-43a97ab6b68b None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:31.590747 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac3b7c-b0de-4df9-bd92-43a97ab6b68b None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:31.594304 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3822664-5937-4910-b794-ea99c33a81e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:31.594894 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3822664-5937-4910-b794-ea99c33a81e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.595175 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3822664-5937-4910-b794-ea99c33a81e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.595543 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3822664-5937-4910-b794-ea99c33a81e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.604966 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3822664-5937-4910-b794-ea99c33a81e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:31.606404 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3822664-5937-4910-b794-ea99c33a81e8 service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:31.615946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 474/950] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:31 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:34.030300 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4272c-bfe7-4790-8653-fc667f06a58c None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:34.030815 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4272c-bfe7-4790-8653-fc667f06a58c None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:34.030815 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4272c-bfe7-4790-8653-fc667f06a58c None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:34.032490 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 477/951] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:34.037406 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a25db0-3aa7-4470-9247-300fda40b300 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:34.037807 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a25db0-3aa7-4470-9247-300fda40b300 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:34.037968 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a25db0-3aa7-4470-9247-300fda40b300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:34.056664 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-00a25db0-3aa7-4470-9247-300fda40b300 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:34.057796 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-00a25db0-3aa7-4470-9247-300fda40b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:34.065622 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 475/952] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:34.408172 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4272c-bfe7-4790-8653-fc667f06a58c None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:34.419802 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4272c-bfe7-4790-8653-fc667f06a58c None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:34.423349 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e007bb6-4d93-4266-a356-2f2a7859fe79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:34.423948 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e007bb6-4d93-4266-a356-2f2a7859fe79 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:34.424221 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e007bb6-4d93-4266-a356-2f2a7859fe79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:34.424542 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e007bb6-4d93-4266-a356-2f2a7859fe79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:34.433632 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e007bb6-4d93-4266-a356-2f2a7859fe79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:34.435037 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e007bb6-4d93-4266-a356-2f2a7859fe79 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:34.444119 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 478/953] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:36.689251 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7b9e9-8e51-4eeb-84e2-ff062d965c5b None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.689860 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7b9e9-8e51-4eeb-84e2-ff062d965c5b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.689860 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7b9e9-8e51-4eeb-84e2-ff062d965c5b None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.691215 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 476/954] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:36.696754 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504a5c5-031a-40ef-bf9b-8ecc6a33461d None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.697242 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504a5c5-031a-40ef-bf9b-8ecc6a33461d None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.697397 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504a5c5-031a-40ef-bf9b-8ecc6a33461d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.716970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-4504a5c5-031a-40ef-bf9b-8ecc6a33461d None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:36.718139 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-4504a5c5-031a-40ef-bf9b-8ecc6a33461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:36.725774 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 479/955] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:37.071303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7b9e9-8e51-4eeb-84e2-ff062d965c5b None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:37.084382 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7b9e9-8e51-4eeb-84e2-ff062d965c5b None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:37.088579 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49996fe-60ba-4087-a59d-4443eb9a002d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:37.089857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49996fe-60ba-4087-a59d-4443eb9a002d service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:37.090580 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49996fe-60ba-4087-a59d-4443eb9a002d service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:37.090580 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49996fe-60ba-4087-a59d-4443eb9a002d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:37.101203 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49996fe-60ba-4087-a59d-4443eb9a002d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:37.102575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49996fe-60ba-4087-a59d-4443eb9a002d service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:37.113118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 477/956] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:39.760839 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98c807-c9a3-4a10-b5d7-5ffd0e785c54 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:39.761449 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98c807-c9a3-4a10-b5d7-5ffd0e785c54 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:39.761449 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98c807-c9a3-4a10-b5d7-5ffd0e785c54 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:39.762731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 480/957] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:39.768312 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70a803-96c3-41e1-b31f-dd2881e5d7e4 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:39.768807 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70a803-96c3-41e1-b31f-dd2881e5d7e4 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:39.768905 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70a803-96c3-41e1-b31f-dd2881e5d7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:39.788643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-1a70a803-96c3-41e1-b31f-dd2881e5d7e4 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:39.789856 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-1a70a803-96c3-41e1-b31f-dd2881e5d7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:39.798370 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 478/958] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:39 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:40.155085 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee4ffd-11ff-4ba3-ab3e-1596236ad7dd None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:40.155397 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee4ffd-11ff-4ba3-ab3e-1596236ad7dd None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:40.155668 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee4ffd-11ff-4ba3-ab3e-1596236ad7dd None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:40.157016 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 481/959] 10.222.0.16 () {54 vars in 965 bytes} [Thu Aug 18 21:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:40.163512 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73557d4b-34b5-49bb-b40b-ab362fd12615 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:40.164104 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73557d4b-34b5-49bb-b40b-ab362fd12615 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:40.164450 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73557d4b-34b5-49bb-b40b-ab362fd12615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:40.186848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-73557d4b-34b5-49bb-b40b-ab362fd12615 None None] MFA Rules not processed for user `b9326ebc83a2471a856f668ee77285c5`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:40.188134 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-73557d4b-34b5-49bb-b40b-ab362fd12615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:40.194925 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 479/960] 10.222.0.16 () {58 vars in 1062 bytes} [Thu Aug 18 21:05:40 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:40.204659 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee4ffd-11ff-4ba3-ab3e-1596236ad7dd None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:40.216906 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee4ffd-11ff-4ba3-ab3e-1596236ad7dd None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:40.220787 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8195d4-5abe-4230-852d-0c79feba0476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:40.221397 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8195d4-5abe-4230-852d-0c79feba0476 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:40.221678 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8195d4-5abe-4230-852d-0c79feba0476 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:40.221949 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8195d4-5abe-4230-852d-0c79feba0476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:40.232720 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8195d4-5abe-4230-852d-0c79feba0476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:40.234276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8195d4-5abe-4230-852d-0c79feba0476 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:40.245051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 482/961] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:40 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:45.229346 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e76355-b3c8-475f-867d-9853fa4dea85 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.229903 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e76355-b3c8-475f-867d-9853fa4dea85 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.229903 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e76355-b3c8-475f-867d-9853fa4dea85 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:45.231586 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 480/962] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:45.236628 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b984680-6644-40d0-a9db-98b9409777b9 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.237083 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b984680-6644-40d0-a9db-98b9409777b9 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.237279 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b984680-6644-40d0-a9db-98b9409777b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:45.256931 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-7b984680-6644-40d0-a9db-98b9409777b9 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:45.258125 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-7b984680-6644-40d0-a9db-98b9409777b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:45.267403 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 483/963] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:45.613529 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e76355-b3c8-475f-867d-9853fa4dea85 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:45.618918 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=77 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:45.625601 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e76355-b3c8-475f-867d-9853fa4dea85 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:45.629055 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b76b1a-0999-4d9e-8df6-108c2d9b2343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:45.629642 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b76b1a-0999-4d9e-8df6-108c2d9b2343 service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.629918 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b76b1a-0999-4d9e-8df6-108c2d9b2343 service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.630183 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b76b1a-0999-4d9e-8df6-108c2d9b2343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:45.639133 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b76b1a-0999-4d9e-8df6-108c2d9b2343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:45.640594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b76b1a-0999-4d9e-8df6-108c2d9b2343 service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:45.650659 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 481/964] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:48.516046 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01beae-3d6f-42bc-a6f5-f6eed86b3e68 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:48.516589 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01beae-3d6f-42bc-a6f5-f6eed86b3e68 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:48.516589 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01beae-3d6f-42bc-a6f5-f6eed86b3e68 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:48.517836 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 484/965] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:48.523114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f802f-949b-4c9a-aece-d766855d7048 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:48.523554 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f802f-949b-4c9a-aece-d766855d7048 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:48.523740 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f802f-949b-4c9a-aece-d766855d7048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:48.548974 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-5a1f802f-949b-4c9a-aece-d766855d7048 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:48.550171 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-5a1f802f-949b-4c9a-aece-d766855d7048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:48.558683 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 482/966] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:48 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:48.899785 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01beae-3d6f-42bc-a6f5-f6eed86b3e68 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:48.910663 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01beae-3d6f-42bc-a6f5-f6eed86b3e68 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:48.914059 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a29811-584c-4499-a54c-feed375326a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:48.914642 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a29811-584c-4499-a54c-feed375326a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:48.914917 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a29811-584c-4499-a54c-feed375326a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:48.915183 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a29811-584c-4499-a54c-feed375326a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:48.924755 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a29811-584c-4499-a54c-feed375326a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:48.926453 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a29811-584c-4499-a54c-feed375326a9 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:48.936953 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 485/967] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:48 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:53.431494 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ee0df-9263-4522-bccf-1874ef9f7804 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:53.432022 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ee0df-9263-4522-bccf-1874ef9f7804 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:53.432022 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ee0df-9263-4522-bccf-1874ef9f7804 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:53.433298 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 483/968] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:53.439211 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a912bb-545a-4077-aa68-9b45a3122def None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:53.439707 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a912bb-545a-4077-aa68-9b45a3122def None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:53.439807 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a912bb-545a-4077-aa68-9b45a3122def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:53.447462 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=54 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:53.462801 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-21a912bb-545a-4077-aa68-9b45a3122def None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:53.463947 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-21a912bb-545a-4077-aa68-9b45a3122def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:53.471696 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 486/969] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:53.812546 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ee0df-9263-4522-bccf-1874ef9f7804 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:53.823140 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ee0df-9263-4522-bccf-1874ef9f7804 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:53.827155 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84f9dc-d4e8-4c5d-acc2-7cdac93c0335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:53.827789 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84f9dc-d4e8-4c5d-acc2-7cdac93c0335 service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:53.828066 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84f9dc-d4e8-4c5d-acc2-7cdac93c0335 service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:53.828336 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84f9dc-d4e8-4c5d-acc2-7cdac93c0335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:53.837980 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84f9dc-d4e8-4c5d-acc2-7cdac93c0335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:53.839441 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84f9dc-d4e8-4c5d-acc2-7cdac93c0335 service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:53.849827 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 484/970] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:59.494786 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb736eb-01c4-4891-bd70-a65d01c03678 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:59.495779 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb736eb-01c4-4891-bd70-a65d01c03678 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:59.496277 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb736eb-01c4-4891-bd70-a65d01c03678 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:59.498171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 487/971] 10.222.0.16 () {54 vars in 921 bytes} [Thu Aug 18 21:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:59.504441 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52461d4f-64c8-4a92-85a6-79c0f7129bb1 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:59.505419 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52461d4f-64c8-4a92-85a6-79c0f7129bb1 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:59.505974 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52461d4f-64c8-4a92-85a6-79c0f7129bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:59.548174 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-52461d4f-64c8-4a92-85a6-79c0f7129bb1 None None] MFA Rules not processed for user `42119f8b3cd5446ea7aca396ad1a0f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:59.549654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-52461d4f-64c8-4a92-85a6-79c0f7129bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:59.634159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 485/972] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Aug 18 21:05:59 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:03.457341 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=2 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:04.358682 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502ddf-4a60-41c0-90b0-69ade44c1165 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:04.359456 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502ddf-4a60-41c0-90b0-69ade44c1165 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:04.360615 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502ddf-4a60-41c0-90b0-69ade44c1165 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:04.362055 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 488/973] 10.222.0.16 () {54 vars in 921 bytes} [Thu Aug 18 21:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:04.367246 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6bffe-eeec-46e1-9d1c-e4a3c83fe154 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:04.367818 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6bffe-eeec-46e1-9d1c-e4a3c83fe154 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:04.367818 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6bffe-eeec-46e1-9d1c-e4a3c83fe154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:04.387738 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-dfa6bffe-eeec-46e1-9d1c-e4a3c83fe154 None None] MFA Rules not processed for user `42119f8b3cd5446ea7aca396ad1a0f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:04.388946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-dfa6bffe-eeec-46e1-9d1c-e4a3c83fe154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:04.397782 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 486/974] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Aug 18 21:06:04 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:06.541387 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0060418-f0d8-418d-9faf-ca2f35e65e6d None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:06.541914 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0060418-f0d8-418d-9faf-ca2f35e65e6d None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:06.542039 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0060418-f0d8-418d-9faf-ca2f35e65e6d None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:06.543958 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 489/975] 10.222.0.16 () {54 vars in 921 bytes} [Thu Aug 18 21:06:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:06.549866 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b24f-0574-485e-8829-e1acf6041a67 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:06.550344 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b24f-0574-485e-8829-e1acf6041a67 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:06.550440 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b24f-0574-485e-8829-e1acf6041a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:06.570476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-5ef4b24f-0574-485e-8829-e1acf6041a67 None None] MFA Rules not processed for user `42119f8b3cd5446ea7aca396ad1a0f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:06.571711 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-5ef4b24f-0574-485e-8829-e1acf6041a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:06.585664 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 487/976] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Aug 18 21:06:06 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:10.281837 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c48ac8-33db-43bf-9112-374d9e26bf92 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:10.282405 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c48ac8-33db-43bf-9112-374d9e26bf92 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:10.283417 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c48ac8-33db-43bf-9112-374d9e26bf92 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:10.285524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 490/977] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:10.292070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68068342-1e5b-4bad-93dd-741aa750ca1f None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:10.292597 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68068342-1e5b-4bad-93dd-741aa750ca1f None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:10.292972 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68068342-1e5b-4bad-93dd-741aa750ca1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:10.320536 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-68068342-1e5b-4bad-93dd-741aa750ca1f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:10.322305 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-68068342-1e5b-4bad-93dd-741aa750ca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:10.340217 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 488/978] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:10.705573 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852622f8-075d-47ea-adec-bbfc0c6f4e22 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:10.706183 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852622f8-075d-47ea-adec-bbfc0c6f4e22 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:10.706676 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852622f8-075d-47ea-adec-bbfc0c6f4e22 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:10.708610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 491/979] 10.222.0.16 () {54 vars in 962 bytes} [Thu Aug 18 21:06:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:10.717914 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85e1cf-1901-46cb-93e0-584c93cef05f None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:10.718642 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85e1cf-1901-46cb-93e0-584c93cef05f None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:10.719147 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85e1cf-1901-46cb-93e0-584c93cef05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:10.763572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-ed85e1cf-1901-46cb-93e0-584c93cef05f None None] MFA Rules not processed for user `ba197525d2af40528f7cbe7de9da9a23`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:10.765148 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-ed85e1cf-1901-46cb-93e0-584c93cef05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:10.841556 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:10.848826 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 489/980] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Aug 18 21:06:10 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:10.856947 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852622f8-075d-47ea-adec-bbfc0c6f4e22 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:10.872206 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852622f8-075d-47ea-adec-bbfc0c6f4e22 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:10.878157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa32da0-c93a-4189-afc6-2ef77eab8ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:10.879020 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa32da0-c93a-4189-afc6-2ef77eab8ad7 service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:10.879572 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa32da0-c93a-4189-afc6-2ef77eab8ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:10.879996 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa32da0-c93a-4189-afc6-2ef77eab8ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:10.889692 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa32da0-c93a-4189-afc6-2ef77eab8ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:10.891695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa32da0-c93a-4189-afc6-2ef77eab8ad7 service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:10.902913 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 492/981] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:06:13.434620 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631f7d1-4814-4313-afd8-ea600133b87f None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:13.435173 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631f7d1-4814-4313-afd8-ea600133b87f None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:13.435173 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631f7d1-4814-4313-afd8-ea600133b87f None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:13.436773 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 490/982] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:13.442826 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f122ec-e604-4ac6-bc63-b64211dc6439 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:13.443549 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f122ec-e604-4ac6-bc63-b64211dc6439 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:13.443549 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f122ec-e604-4ac6-bc63-b64211dc6439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:13.463403 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-88f122ec-e604-4ac6-bc63-b64211dc6439 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:13.464882 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-88f122ec-e604-4ac6-bc63-b64211dc6439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:13.486328 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 493/983] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:13.835171 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631f7d1-4814-4313-afd8-ea600133b87f None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:13.851576 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631f7d1-4814-4313-afd8-ea600133b87f None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:13.857213 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1578ae-3778-4afa-9ed3-9f383dada8f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:13.858074 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1578ae-3778-4afa-9ed3-9f383dada8f6 service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:13.858520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1578ae-3778-4afa-9ed3-9f383dada8f6 service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:13.859073 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1578ae-3778-4afa-9ed3-9f383dada8f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:13.871250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1578ae-3778-4afa-9ed3-9f383dada8f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:13.873505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1578ae-3778-4afa-9ed3-9f383dada8f6 service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:13.887196 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 491/984] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:16.686785 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9a269-a2c9-495d-b1aa-6fda2df9b1ab None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:16.687659 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9a269-a2c9-495d-b1aa-6fda2df9b1ab None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:16.687929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9a269-a2c9-495d-b1aa-6fda2df9b1ab None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:16.689496 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 494/985] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:16.695137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a394-e3f6-46c2-9091-c741611fac7a None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:16.695622 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a394-e3f6-46c2-9091-c741611fac7a None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:16.695859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a394-e3f6-46c2-9091-c741611fac7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:16.719179 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-54c9a394-e3f6-46c2-9091-c741611fac7a None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:16.720587 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-54c9a394-e3f6-46c2-9091-c741611fac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:16.731788 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 492/986] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:17.087766 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcec56-446b-4b21-9fb4-148df36b0d7c None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.088105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcec56-446b-4b21-9fb4-148df36b0d7c None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.088569 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcec56-446b-4b21-9fb4-148df36b0d7c None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.091144 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 495/987] 10.222.0.16 () {54 vars in 962 bytes} [Thu Aug 18 21:06:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:17.097400 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddb543-76d7-4260-99f0-1a06503ebf48 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.097695 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddb543-76d7-4260-99f0-1a06503ebf48 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.097976 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddb543-76d7-4260-99f0-1a06503ebf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.120311 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-39ddb543-76d7-4260-99f0-1a06503ebf48 None None] MFA Rules not processed for user `ba197525d2af40528f7cbe7de9da9a23`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:17.122749 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-39ddb543-76d7-4260-99f0-1a06503ebf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:17.132407 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 493/988] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Aug 18 21:06:17 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:17.144875 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcec56-446b-4b21-9fb4-148df36b0d7c None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.163552 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcec56-446b-4b21-9fb4-148df36b0d7c None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.172431 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c9381-803a-4459-9856-371cd9c65b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.173317 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9381-803a-4459-9856-371cd9c65b4d service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.173594 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9381-803a-4459-9856-371cd9c65b4d service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.173869 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9381-803a-4459-9856-371cd9c65b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.185791 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c9381-803a-4459-9856-371cd9c65b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.187732 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c9381-803a-4459-9856-371cd9c65b4d service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.208134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 496/989] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:19.594830 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14d4f-2ca4-4a05-b6de-a59fa61a62ab None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:19.595769 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14d4f-2ca4-4a05-b6de-a59fa61a62ab None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:19.596208 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14d4f-2ca4-4a05-b6de-a59fa61a62ab None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:19.603656 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8b55d-5b41-4db7-b25c-ec03ca64c723 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:19.604479 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8b55d-5b41-4db7-b25c-ec03ca64c723 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:19.604919 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8b55d-5b41-4db7-b25c-ec03ca64c723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:19.607666 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 494/990] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:19.625549 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-aca8b55d-5b41-4db7-b25c-ec03ca64c723 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:19.627048 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-aca8b55d-5b41-4db7-b25c-ec03ca64c723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:19.647683 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 497/991] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:19.990563 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b14d4f-2ca4-4a05-b6de-a59fa61a62ab None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:20.013913 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b14d4f-2ca4-4a05-b6de-a59fa61a62ab None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:20.022466 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95d7a5-4c9b-46a0-9b92-9ebf5c69181d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:20.023494 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95d7a5-4c9b-46a0-9b92-9ebf5c69181d service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:20.024179 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95d7a5-4c9b-46a0-9b92-9ebf5c69181d service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:20.024636 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95d7a5-4c9b-46a0-9b92-9ebf5c69181d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:20.041800 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95d7a5-4c9b-46a0-9b92-9ebf5c69181d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:20.044751 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95d7a5-4c9b-46a0-9b92-9ebf5c69181d service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:20.067398 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 495/992] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:21.099980 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dbd94-bc6d-4c1b-8ca9-0d50ac22ef1d None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:21.100418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dbd94-bc6d-4c1b-8ca9-0d50ac22ef1d None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:21.100640 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dbd94-bc6d-4c1b-8ca9-0d50ac22ef1d None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:21.102195 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 498/993] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:21.107450 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86867-d861-4c62-a71c-3b1138dc8976 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:21.107879 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86867-d861-4c62-a71c-3b1138dc8976 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:21.108047 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86867-d861-4c62-a71c-3b1138dc8976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:21.129328 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-d0b86867-d861-4c62-a71c-3b1138dc8976 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:21.130594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-d0b86867-d861-4c62-a71c-3b1138dc8976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:21.138961 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 496/994] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:21.755753 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734869e-1b19-45fb-80f8-a08a0433c97e None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:21.755753 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734869e-1b19-45fb-80f8-a08a0433c97e None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:21.755753 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734869e-1b19-45fb-80f8-a08a0433c97e None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:21.757331 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 499/995] 10.222.0.16 () {54 vars in 964 bytes} [Thu Aug 18 21:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:21.761468 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c1e02-6b7f-43bf-bcbc-16874e38dfa7 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:21.761758 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c1e02-6b7f-43bf-bcbc-16874e38dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:21.762033 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c1e02-6b7f-43bf-bcbc-16874e38dfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:21.802557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-fd8c1e02-6b7f-43bf-bcbc-16874e38dfa7 None None] MFA Rules not processed for user `3510dd48a215455fb55bfbec820c7f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:21.803785 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-fd8c1e02-6b7f-43bf-bcbc-16874e38dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:21.871067 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 497/996] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Aug 18 21:06:21 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:21.879365 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734869e-1b19-45fb-80f8-a08a0433c97e None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:21.890572 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734869e-1b19-45fb-80f8-a08a0433c97e None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:21.895144 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60786420-6ecf-4387-8293-66e0de73d1c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3510dd48a215455fb55bfbec820c7f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:21.895832 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60786420-6ecf-4387-8293-66e0de73d1c1 service cinder] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:21.896107 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60786420-6ecf-4387-8293-66e0de73d1c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:21.896553 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60786420-6ecf-4387-8293-66e0de73d1c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:21.908005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60786420-6ecf-4387-8293-66e0de73d1c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:21.910163 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60786420-6ecf-4387-8293-66e0de73d1c1 service cinder] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:21.924638 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 500/997] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:22.445602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884cb4c-5bc0-4ce0-930e-5272f49b9bd6 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:22.449372 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884cb4c-5bc0-4ce0-930e-5272f49b9bd6 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:22.449372 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884cb4c-5bc0-4ce0-930e-5272f49b9bd6 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:22.449372 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 498/998] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:22.453395 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b73c4-8951-4bc2-a38f-e7f3bead7b8f None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:22.453899 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b73c4-8951-4bc2-a38f-e7f3bead7b8f None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:22.453978 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b73c4-8951-4bc2-a38f-e7f3bead7b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:22.479618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-148b73c4-8951-4bc2-a38f-e7f3bead7b8f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:22.480870 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-148b73c4-8951-4bc2-a38f-e7f3bead7b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:22.489999 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 501/999] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:22.856298 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884cb4c-5bc0-4ce0-930e-5272f49b9bd6 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:22.872490 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884cb4c-5bc0-4ce0-930e-5272f49b9bd6 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:22.878859 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e593ea-ecbe-4bcd-b30d-40e5692871de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:22.879534 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e593ea-ecbe-4bcd-b30d-40e5692871de service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:22.879854 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e593ea-ecbe-4bcd-b30d-40e5692871de service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:22.880173 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e593ea-ecbe-4bcd-b30d-40e5692871de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:22.889999 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e593ea-ecbe-4bcd-b30d-40e5692871de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:22.892025 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e593ea-ecbe-4bcd-b30d-40e5692871de service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:22.903589 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 499/1000] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:25.209645 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b76b08-1c21-437d-9087-c30cc091e5dd None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.210138 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b76b08-1c21-437d-9087-c30cc091e5dd None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.210322 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b76b08-1c21-437d-9087-c30cc091e5dd None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.211972 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 502/1001] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:25.227958 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf61f42-b1f2-4f97-8772-01219e033d96 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.228506 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf61f42-b1f2-4f97-8772-01219e033d96 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.228506 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf61f42-b1f2-4f97-8772-01219e033d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.248385 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-baf61f42-b1f2-4f97-8772-01219e033d96 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:25.249583 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-baf61f42-b1f2-4f97-8772-01219e033d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:25.257886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 500/1002] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:25.651040 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b76b08-1c21-437d-9087-c30cc091e5dd None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:25.670218 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b76b08-1c21-437d-9087-c30cc091e5dd None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:25.675870 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bf50f-a34c-45b7-bc05-d2ae3a676500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:25.676493 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf50f-a34c-45b7-bc05-d2ae3a676500 service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.676768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf50f-a34c-45b7-bc05-d2ae3a676500 service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.677037 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf50f-a34c-45b7-bc05-d2ae3a676500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.693584 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bf50f-a34c-45b7-bc05-d2ae3a676500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:25.696760 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bf50f-a34c-45b7-bc05-d2ae3a676500 service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:25.711745 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 503/1003] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:28.259681 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1b2e0-413a-4bac-b87e-a42e6ef7aeb3 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:28.260401 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1b2e0-413a-4bac-b87e-a42e6ef7aeb3 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:28.260401 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1b2e0-413a-4bac-b87e-a42e6ef7aeb3 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:28.263774 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 501/1004] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:28.267684 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76782c-a9df-4f25-b89f-3ee725f32281 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:28.268273 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76782c-a9df-4f25-b89f-3ee725f32281 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:28.268273 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76782c-a9df-4f25-b89f-3ee725f32281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:28.290355 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-7c76782c-a9df-4f25-b89f-3ee725f32281 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:28.291619 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-7c76782c-a9df-4f25-b89f-3ee725f32281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:28.303707 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 504/1005] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:28.648983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1b2e0-413a-4bac-b87e-a42e6ef7aeb3 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:28.666198 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1b2e0-413a-4bac-b87e-a42e6ef7aeb3 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:28.674497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b97208-05b6-4526-9ec2-798f8e3fc8ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:28.675472 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b97208-05b6-4526-9ec2-798f8e3fc8ab service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:28.676508 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b97208-05b6-4526-9ec2-798f8e3fc8ab service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:28.677338 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b97208-05b6-4526-9ec2-798f8e3fc8ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:28.692811 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b97208-05b6-4526-9ec2-798f8e3fc8ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:28.695707 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b97208-05b6-4526-9ec2-798f8e3fc8ab service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:28.713935 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 502/1006] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:31.125615 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590195fa-d8cc-4c08-be70-66fa68d0f1c6 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:31.126238 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590195fa-d8cc-4c08-be70-66fa68d0f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:31.126238 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590195fa-d8cc-4c08-be70-66fa68d0f1c6 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:31.127467 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 505/1007] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:31.133426 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2cc77-c40e-4261-b6f3-419e7c183472 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:31.134098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2cc77-c40e-4261-b6f3-419e7c183472 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:31.134098 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2cc77-c40e-4261-b6f3-419e7c183472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:31.156159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-39a2cc77-c40e-4261-b6f3-419e7c183472 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:31.157412 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-39a2cc77-c40e-4261-b6f3-419e7c183472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:31.167692 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 503/1008] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:31.613573 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590195fa-d8cc-4c08-be70-66fa68d0f1c6 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:31.628563 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590195fa-d8cc-4c08-be70-66fa68d0f1c6 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:31.634988 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494e717-048d-4d24-a5fb-d7e6886b64a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:31.635662 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e717-048d-4d24-a5fb-d7e6886b64a6 service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:31.635946 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e717-048d-4d24-a5fb-d7e6886b64a6 service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:31.636218 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e717-048d-4d24-a5fb-d7e6886b64a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:31.646077 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494e717-048d-4d24-a5fb-d7e6886b64a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:31.647719 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494e717-048d-4d24-a5fb-d7e6886b64a6 service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:31.657478 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 506/1009] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:06:34.304121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5f5d-7260-4fc2-ad1d-65c0ef92e78c None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:34.306955 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5f5d-7260-4fc2-ad1d-65c0ef92e78c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:34.306955 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5f5d-7260-4fc2-ad1d-65c0ef92e78c None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:34.307796 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 504/1010] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:34.313707 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35319f6d-db90-4666-aa03-64573c0838a3 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:34.314453 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35319f6d-db90-4666-aa03-64573c0838a3 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:34.314453 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35319f6d-db90-4666-aa03-64573c0838a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:34.327808 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=43 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:34.340708 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-35319f6d-db90-4666-aa03-64573c0838a3 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:34.341960 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-35319f6d-db90-4666-aa03-64573c0838a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:34.352625 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 507/1011] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:34.814612 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb5f5d-7260-4fc2-ad1d-65c0ef92e78c None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:34.834628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb5f5d-7260-4fc2-ad1d-65c0ef92e78c None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:34.845690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0114010-3719-4869-8530-6f535880ac93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:34.846614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0114010-3719-4869-8530-6f535880ac93 service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:34.847108 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0114010-3719-4869-8530-6f535880ac93 service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:34.847531 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0114010-3719-4869-8530-6f535880ac93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:34.857948 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0114010-3719-4869-8530-6f535880ac93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:34.859519 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0114010-3719-4869-8530-6f535880ac93 service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:34.870743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 505/1012] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:38.007696 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2674c23-16de-4c05-8ba6-3c173406f8c4 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:38.008698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2674c23-16de-4c05-8ba6-3c173406f8c4 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:38.008698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2674c23-16de-4c05-8ba6-3c173406f8c4 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:38.009725 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 508/1013] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:38.017206 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc997187-d383-459b-a742-43d7843fd9b4 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:38.018143 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc997187-d383-459b-a742-43d7843fd9b4 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:38.018324 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc997187-d383-459b-a742-43d7843fd9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:38.052747 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-bc997187-d383-459b-a742-43d7843fd9b4 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:38.055012 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-bc997187-d383-459b-a742-43d7843fd9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:38.069674 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 506/1014] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:38.691419 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2674c23-16de-4c05-8ba6-3c173406f8c4 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:38.712516 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2674c23-16de-4c05-8ba6-3c173406f8c4 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:38.721573 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d06db-45f3-44b3-814d-3e862e4e1450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:38.722605 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d06db-45f3-44b3-814d-3e862e4e1450 service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:38.723072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d06db-45f3-44b3-814d-3e862e4e1450 service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:38.723521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d06db-45f3-44b3-814d-3e862e4e1450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:38.737859 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d06db-45f3-44b3-814d-3e862e4e1450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:38.740398 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d06db-45f3-44b3-814d-3e862e4e1450 service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:38.764629 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 509/1015] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:39.225032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e210a-700e-4d49-b828-904a731e8ba4 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:39.225595 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e210a-700e-4d49-b828-904a731e8ba4 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:39.225595 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e210a-700e-4d49-b828-904a731e8ba4 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:39.227158 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 507/1016] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:39.232775 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32022d9c-6eb2-421d-bf3d-573d9a03aeee None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:39.233606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32022d9c-6eb2-421d-bf3d-573d9a03aeee None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:39.233606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32022d9c-6eb2-421d-bf3d-573d9a03aeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:39.257834 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-32022d9c-6eb2-421d-bf3d-573d9a03aeee None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:39.259325 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-32022d9c-6eb2-421d-bf3d-573d9a03aeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:39.267721 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 510/1017] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:39.658250 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92f5ba-15a5-41c1-a4a1-a74eb7acc57b None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:39.658675 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92f5ba-15a5-41c1-a4a1-a74eb7acc57b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:39.659043 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92f5ba-15a5-41c1-a4a1-a74eb7acc57b None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:39.660549 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 508/1018] 10.222.0.16 () {54 vars in 967 bytes} [Thu Aug 18 21:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:39.667911 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b2bdc-7237-4a73-ab57-1120ff6c079e None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:39.668362 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b2bdc-7237-4a73-ab57-1120ff6c079e None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:39.668857 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b2bdc-7237-4a73-ab57-1120ff6c079e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:39.737007 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-736b2bdc-7237-4a73-ab57-1120ff6c079e None None] MFA Rules not processed for user `255b174cea9f41f6970978c44bec2b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:39.739573 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-736b2bdc-7237-4a73-ab57-1120ff6c079e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:39.840647 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 511/1019] 10.222.0.16 () {58 vars in 1064 bytes} [Thu Aug 18 21:06:39 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:39.849040 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92f5ba-15a5-41c1-a4a1-a74eb7acc57b None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:39.861310 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92f5ba-15a5-41c1-a4a1-a74eb7acc57b None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:39.865784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd07724-a199-4884-a0ed-ba9ecfc166a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255b174cea9f41f6970978c44bec2b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:39.866628 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd07724-a199-4884-a0ed-ba9ecfc166a1 service glance] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:39.866963 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd07724-a199-4884-a0ed-ba9ecfc166a1 service glance] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:39.867362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd07724-a199-4884-a0ed-ba9ecfc166a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:39.877302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd07724-a199-4884-a0ed-ba9ecfc166a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:39.879316 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd07724-a199-4884-a0ed-ba9ecfc166a1 service glance] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:39.890607 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 509/1020] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:41.487613 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d75659-fa1d-4b25-ba24-3afebbf5eb8a None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:41.488654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d75659-fa1d-4b25-ba24-3afebbf5eb8a None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:41.488654 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d75659-fa1d-4b25-ba24-3afebbf5eb8a None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:41.490100 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 512/1021] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:41.496689 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1261319-8bdc-4b6e-840d-12c6d8c41e6e None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:41.497644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1261319-8bdc-4b6e-840d-12c6d8c41e6e None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:41.497644 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1261319-8bdc-4b6e-840d-12c6d8c41e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:41.505877 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=89 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:41.523728 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-f1261319-8bdc-4b6e-840d-12c6d8c41e6e None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:41.525757 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-f1261319-8bdc-4b6e-840d-12c6d8c41e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:41.539996 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 510/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:42.034596 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d75659-fa1d-4b25-ba24-3afebbf5eb8a None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:42.064551 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d75659-fa1d-4b25-ba24-3afebbf5eb8a None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:42.070980 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b064d-c5bf-442a-93b3-d1dc3873f132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:42.071771 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b064d-c5bf-442a-93b3-d1dc3873f132 service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:42.072110 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b064d-c5bf-442a-93b3-d1dc3873f132 service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:42.072441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b064d-c5bf-442a-93b3-d1dc3873f132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:42.084948 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b064d-c5bf-442a-93b3-d1dc3873f132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:42.086777 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b064d-c5bf-442a-93b3-d1dc3873f132 service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:42.168275 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 513/1023] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:45.131986 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c31a0-561e-4d58-8e07-35be9bb61df3 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.131986 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c31a0-561e-4d58-8e07-35be9bb61df3 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.131986 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c31a0-561e-4d58-8e07-35be9bb61df3 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.131986 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 511/1024] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:06:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:45.139046 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec381b1-3ed2-4245-8ea2-b4bf1a9f92f7 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.139971 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec381b1-3ed2-4245-8ea2-b4bf1a9f92f7 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.139971 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec381b1-3ed2-4245-8ea2-b4bf1a9f92f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.169914 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-dec381b1-3ed2-4245-8ea2-b4bf1a9f92f7 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:45.172152 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-dec381b1-3ed2-4245-8ea2-b4bf1a9f92f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:45.182420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 514/1025] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:45.610944 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c31a0-561e-4d58-8e07-35be9bb61df3 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:45.630403 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c31a0-561e-4d58-8e07-35be9bb61df3 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:45.636411 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d04f3a-8aa2-4fa5-83f9-4f63e43fd921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:45.637249 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d04f3a-8aa2-4fa5-83f9-4f63e43fd921 service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.637743 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d04f3a-8aa2-4fa5-83f9-4f63e43fd921 service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.638096 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d04f3a-8aa2-4fa5-83f9-4f63e43fd921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.658032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d04f3a-8aa2-4fa5-83f9-4f63e43fd921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:45.659959 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d04f3a-8aa2-4fa5-83f9-4f63e43fd921 service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:45.672307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 512/1026] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:06:55.164607 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=53 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:55.667340 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=8 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:58.651758 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4eae50-660c-4dd3-93c1-ca3ec0397d51 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:58.652771 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4eae50-660c-4dd3-93c1-ca3ec0397d51 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:58.652771 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4eae50-660c-4dd3-93c1-ca3ec0397d51 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:58.654402 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 515/1027] 10.222.0.16 () {54 vars in 918 bytes} [Thu Aug 18 21:06:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:58.663474 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e0da7-f208-435b-a0fe-51c9a5b72bfe None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:58.664307 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e0da7-f208-435b-a0fe-51c9a5b72bfe None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:58.664411 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e0da7-f208-435b-a0fe-51c9a5b72bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:58.698391 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-cb7e0da7-f208-435b-a0fe-51c9a5b72bfe None None] MFA Rules not processed for user `42119f8b3cd5446ea7aca396ad1a0f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:58.700545 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-cb7e0da7-f208-435b-a0fe-51c9a5b72bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:58.714357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 513/1028] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Aug 18 21:06:58 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:58.740005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0fc66-8bd2-4ba5-9983-1fcde204242e None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:58.740344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0fc66-8bd2-4ba5-9983-1fcde204242e None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:58.740740 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0fc66-8bd2-4ba5-9983-1fcde204242e None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:58.743046 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 516/1029] 10.222.0.16 () {54 vars in 918 bytes} [Thu Aug 18 21:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:58.751494 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17302-aa65-4022-b903-2d3a98fc0860 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:58.752005 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17302-aa65-4022-b903-2d3a98fc0860 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:58.752507 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17302-aa65-4022-b903-2d3a98fc0860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:58.786022 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-a2b17302-aa65-4022-b903-2d3a98fc0860 None None] MFA Rules not processed for user `ba197525d2af40528f7cbe7de9da9a23`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:58.787299 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-a2b17302-aa65-4022-b903-2d3a98fc0860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:58.796725 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 514/1030] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Aug 18 21:06:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:01.865196 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee1ce6-c967-42aa-8b1d-13d23371f8bd None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:01.865804 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee1ce6-c967-42aa-8b1d-13d23371f8bd None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:01.865804 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee1ce6-c967-42aa-8b1d-13d23371f8bd None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:01.867009 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 517/1031] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:01.872594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8379c4-439b-4799-9d87-90a4f7ca7e81 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:01.873459 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8379c4-439b-4799-9d87-90a4f7ca7e81 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:01.873459 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8379c4-439b-4799-9d87-90a4f7ca7e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:01.893197 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-3c8379c4-439b-4799-9d87-90a4f7ca7e81 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:01.894415 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-3c8379c4-439b-4799-9d87-90a4f7ca7e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:01.903104 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 515/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:07:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:02.260216 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee1ce6-c967-42aa-8b1d-13d23371f8bd None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:02.275484 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee1ce6-c967-42aa-8b1d-13d23371f8bd None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:02.280874 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320778f6-184c-4830-9891-917a6435963d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:02.281519 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320778f6-184c-4830-9891-917a6435963d service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:02.281833 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320778f6-184c-4830-9891-917a6435963d service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:02.282148 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320778f6-184c-4830-9891-917a6435963d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:02.295728 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320778f6-184c-4830-9891-917a6435963d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:02.298241 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320778f6-184c-4830-9891-917a6435963d service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:02.310413 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 518/1033] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:03.363848 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe9024-ef3e-47e3-80aa-faa8c2b76719 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:03.364463 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe9024-ef3e-47e3-80aa-faa8c2b76719 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:03.364573 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe9024-ef3e-47e3-80aa-faa8c2b76719 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:03.366655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 516/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:07:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:03.374300 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d231c-bf42-4a9f-86cf-28ef64f51a2f None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:03.375103 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d231c-bf42-4a9f-86cf-28ef64f51a2f None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:03.375314 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d231c-bf42-4a9f-86cf-28ef64f51a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:03.406188 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-493d231c-bf42-4a9f-86cf-28ef64f51a2f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:03.408275 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-493d231c-bf42-4a9f-86cf-28ef64f51a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:03.422049 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 519/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:07:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:07:03.690434 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe9024-ef3e-47e3-80aa-faa8c2b76719 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:03.705260 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe9024-ef3e-47e3-80aa-faa8c2b76719 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:03.710542 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab008c6-ec58-444b-8ff7-7de963d7653a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:03.711181 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab008c6-ec58-444b-8ff7-7de963d7653a service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:03.711506 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab008c6-ec58-444b-8ff7-7de963d7653a service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:03.711778 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab008c6-ec58-444b-8ff7-7de963d7653a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:03.725918 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab008c6-ec58-444b-8ff7-7de963d7653a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:03.728124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab008c6-ec58-444b-8ff7-7de963d7653a service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:03.738370 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 517/1036] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:04.706129 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036ed7e-bfc1-47b5-9a5b-a2bb96891c3c None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:04.706858 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036ed7e-bfc1-47b5-9a5b-a2bb96891c3c None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:04.707246 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036ed7e-bfc1-47b5-9a5b-a2bb96891c3c None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:04.709622 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 520/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:07:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:04.717374 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128f856-f121-4f37-ba5e-f24b80b1cf77 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:04.717987 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128f856-f121-4f37-ba5e-f24b80b1cf77 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:04.718340 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128f856-f121-4f37-ba5e-f24b80b1cf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:04.750694 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-1128f856-f121-4f37-ba5e-f24b80b1cf77 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:04.752276 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-1128f856-f121-4f37-ba5e-f24b80b1cf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:04.765865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 518/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:07:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:04.924966 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036ed7e-bfc1-47b5-9a5b-a2bb96891c3c None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:04.939527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036ed7e-bfc1-47b5-9a5b-a2bb96891c3c None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:04.944673 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829ba5c-ff67-463e-afeb-c827d61ad1cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:04.945283 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ba5c-ff67-463e-afeb-c827d61ad1cd service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:04.945560 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ba5c-ff67-463e-afeb-c827d61ad1cd service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:04.946383 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ba5c-ff67-463e-afeb-c827d61ad1cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:04.956894 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829ba5c-ff67-463e-afeb-c827d61ad1cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:04.959787 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829ba5c-ff67-463e-afeb-c827d61ad1cd service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:04.977915 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 521/1039] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:07:05.945231 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6be0a-3fb1-4c45-a5ba-e2f8c1439ee9 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:05.946301 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6be0a-3fb1-4c45-a5ba-e2f8c1439ee9 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:05.946451 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6be0a-3fb1-4c45-a5ba-e2f8c1439ee9 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:05.948826 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 519/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:07:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:05.954536 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e9006-31d7-40ab-9f56-b83185755c41 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:05.955136 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e9006-31d7-40ab-9f56-b83185755c41 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:05.955136 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e9006-31d7-40ab-9f56-b83185755c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:05.978783 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-aa2e9006-31d7-40ab-9f56-b83185755c41 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:05.980960 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-aa2e9006-31d7-40ab-9f56-b83185755c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:05.994293 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 522/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:07:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:07:06.160069 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6be0a-3fb1-4c45-a5ba-e2f8c1439ee9 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:06.176355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6be0a-3fb1-4c45-a5ba-e2f8c1439ee9 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:06.182981 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6e09b-4ad1-4b62-9229-b55b49cdffa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:06.183955 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6e09b-4ad1-4b62-9229-b55b49cdffa0 service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:06.184473 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6e09b-4ad1-4b62-9229-b55b49cdffa0 service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:06.184952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6e09b-4ad1-4b62-9229-b55b49cdffa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:06.200698 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6e09b-4ad1-4b62-9229-b55b49cdffa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:06.203132 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6e09b-4ad1-4b62-9229-b55b49cdffa0 service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:06.214249 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 520/1042] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:07.204771 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e3165-8eb2-405f-b950-52afcc14f9af None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:07.205599 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e3165-8eb2-405f-b950-52afcc14f9af None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:07.205599 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e3165-8eb2-405f-b950-52afcc14f9af None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:07.206646 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 523/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:07.212672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94916d7-2f93-4e6a-8e14-277863652f8f None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:07.213136 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94916d7-2f93-4e6a-8e14-277863652f8f None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:07.213232 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94916d7-2f93-4e6a-8e14-277863652f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:07.240849 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-e94916d7-2f93-4e6a-8e14-277863652f8f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:07.242168 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-e94916d7-2f93-4e6a-8e14-277863652f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:07.250617 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 521/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:07:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:07.418823 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e3165-8eb2-405f-b950-52afcc14f9af None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:07.439391 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e3165-8eb2-405f-b950-52afcc14f9af None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:07.447763 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9a4dd-ee7e-4a0f-8898-8f4a1608c5e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:07.448769 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9a4dd-ee7e-4a0f-8898-8f4a1608c5e8 service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:07.449211 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9a4dd-ee7e-4a0f-8898-8f4a1608c5e8 service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:07.449645 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9a4dd-ee7e-4a0f-8898-8f4a1608c5e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:07.464902 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9a4dd-ee7e-4a0f-8898-8f4a1608c5e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:07.467715 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9a4dd-ee7e-4a0f-8898-8f4a1608c5e8 service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:07.479075 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 524/1045] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:08.330685 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326d12a-c6d5-4b13-8384-ebe8a43ff5a0 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:08.331566 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326d12a-c6d5-4b13-8384-ebe8a43ff5a0 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:08.331566 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326d12a-c6d5-4b13-8384-ebe8a43ff5a0 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:08.332643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 522/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:08.338200 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5e3b5-01ff-4a64-9931-3c4eb78ac213 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:08.338786 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5e3b5-01ff-4a64-9931-3c4eb78ac213 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:08.338786 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5e3b5-01ff-4a64-9931-3c4eb78ac213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:08.360395 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-54e5e3b5-01ff-4a64-9931-3c4eb78ac213 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:08.361821 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-54e5e3b5-01ff-4a64-9931-3c4eb78ac213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:08.370889 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 525/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:07:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:08.533137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326d12a-c6d5-4b13-8384-ebe8a43ff5a0 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:08.550658 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326d12a-c6d5-4b13-8384-ebe8a43ff5a0 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:08.558466 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95748e20-c14a-4c18-bf6a-d707582caaac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:08.559380 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95748e20-c14a-4c18-bf6a-d707582caaac service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:08.559799 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95748e20-c14a-4c18-bf6a-d707582caaac service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:08.560233 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95748e20-c14a-4c18-bf6a-d707582caaac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:08.570371 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95748e20-c14a-4c18-bf6a-d707582caaac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:08.572066 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95748e20-c14a-4c18-bf6a-d707582caaac service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:08.582698 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 523/1048] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:09.472512 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf622-0d88-4902-91ca-706d7c8d16b2 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:09.475486 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf622-0d88-4902-91ca-706d7c8d16b2 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:09.475486 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf622-0d88-4902-91ca-706d7c8d16b2 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:09.475962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 526/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:07:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:09.483182 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7e9b6-d9bd-4a4d-b1c4-8c400318e5f8 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:09.483744 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7e9b6-d9bd-4a4d-b1c4-8c400318e5f8 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:09.483863 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7e9b6-d9bd-4a4d-b1c4-8c400318e5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:09.504575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-3bf7e9b6-d9bd-4a4d-b1c4-8c400318e5f8 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:09.505813 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-3bf7e9b6-d9bd-4a4d-b1c4-8c400318e5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:09.515110 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 524/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:07:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:07:09.750517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf622-0d88-4902-91ca-706d7c8d16b2 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:09.769344 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf622-0d88-4902-91ca-706d7c8d16b2 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:09.776039 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc6e34-dafb-4346-b81c-736e0e2cb9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:09.776783 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6e34-dafb-4346-b81c-736e0e2cb9d4 service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:09.777157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6e34-dafb-4346-b81c-736e0e2cb9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:09.777524 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6e34-dafb-4346-b81c-736e0e2cb9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:09.789348 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc6e34-dafb-4346-b81c-736e0e2cb9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:09.792799 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc6e34-dafb-4346-b81c-736e0e2cb9d4 service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:09.810150 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 527/1051] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:10.693607 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48a0b8-85cb-4679-8b6d-87ceec5f142e None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:10.694204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48a0b8-85cb-4679-8b6d-87ceec5f142e None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:10.694204 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48a0b8-85cb-4679-8b6d-87ceec5f142e None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:10.695625 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 525/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:10.701422 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764dab3-929d-4847-9d51-53534d6a22f3 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:10.702175 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764dab3-929d-4847-9d51-53534d6a22f3 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:10.702175 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764dab3-929d-4847-9d51-53534d6a22f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:10.723706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-8764dab3-929d-4847-9d51-53534d6a22f3 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:10.724939 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-8764dab3-929d-4847-9d51-53534d6a22f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:10.733153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 528/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:07:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:07:10.893894 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48a0b8-85cb-4679-8b6d-87ceec5f142e None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:10.908554 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48a0b8-85cb-4679-8b6d-87ceec5f142e None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:10.914406 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a79611-ea11-44f2-b79d-d077c128aeed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:10.915081 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79611-ea11-44f2-b79d-d077c128aeed service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:10.915475 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79611-ea11-44f2-b79d-d077c128aeed service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:10.915799 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79611-ea11-44f2-b79d-d077c128aeed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:10.925730 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a79611-ea11-44f2-b79d-d077c128aeed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:10.927516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a79611-ea11-44f2-b79d-d077c128aeed service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:10.938689 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 526/1054] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:11.860363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae61d7-a892-4765-8a08-ad9d1e345e42 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:11.861193 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae61d7-a892-4765-8a08-ad9d1e345e42 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:11.861193 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae61d7-a892-4765-8a08-ad9d1e345e42 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:11.862201 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 529/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:11.868570 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c2f2b-d075-4511-99ca-0a082d65607f None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:11.869265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c2f2b-d075-4511-99ca-0a082d65607f None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:11.869265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c2f2b-d075-4511-99ca-0a082d65607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:11.892249 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-633c2f2b-d075-4511-99ca-0a082d65607f None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:11.894305 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-633c2f2b-d075-4511-99ca-0a082d65607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:11.908942 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 527/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:07:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:07:12.065754 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae61d7-a892-4765-8a08-ad9d1e345e42 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:12.080942 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae61d7-a892-4765-8a08-ad9d1e345e42 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:12.087834 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2a8fd-8fec-45af-a75a-160273156462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:12.088444 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2a8fd-8fec-45af-a75a-160273156462 service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:12.088444 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2a8fd-8fec-45af-a75a-160273156462 service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:12.088634 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2a8fd-8fec-45af-a75a-160273156462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:12.100975 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2a8fd-8fec-45af-a75a-160273156462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:12.102601 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2a8fd-8fec-45af-a75a-160273156462 service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:12.117368 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 530/1057] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:14.582979 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea533f-ac50-436b-a684-69a2e4c157ce None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:14.583614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea533f-ac50-436b-a684-69a2e4c157ce None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:14.583974 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea533f-ac50-436b-a684-69a2e4c157ce None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:14.586282 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 528/1058] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:07:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:14.594875 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591951ab-5c47-4330-ae80-c0d4ad3cfd44 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:14.595766 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591951ab-5c47-4330-ae80-c0d4ad3cfd44 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:14.595766 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591951ab-5c47-4330-ae80-c0d4ad3cfd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:14.621928 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-591951ab-5c47-4330-ae80-c0d4ad3cfd44 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:14.621928 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-591951ab-5c47-4330-ae80-c0d4ad3cfd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:14.628312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 531/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:07:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:14.993254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea533f-ac50-436b-a684-69a2e4c157ce None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:15.012713 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea533f-ac50-436b-a684-69a2e4c157ce None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:15.018939 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dbaf5-3de6-4d92-8537-aa7e3c901d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:15.020017 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dbaf5-3de6-4d92-8537-aa7e3c901d3e service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:15.020505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dbaf5-3de6-4d92-8537-aa7e3c901d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:15.020984 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dbaf5-3de6-4d92-8537-aa7e3c901d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:15.034792 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dbaf5-3de6-4d92-8537-aa7e3c901d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:15.036344 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dbaf5-3de6-4d92-8537-aa7e3c901d3e service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:15.048321 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 529/1060] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:17.724088 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70480e97-a956-4ec0-ab08-52e156653747 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:17.724886 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70480e97-a956-4ec0-ab08-52e156653747 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:17.724886 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70480e97-a956-4ec0-ab08-52e156653747 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:17.726202 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 532/1061] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:17.732720 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9644c87-9a4a-49d5-a7d0-3ac8e9282b47 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:17.733837 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9644c87-9a4a-49d5-a7d0-3ac8e9282b47 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:17.734370 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9644c87-9a4a-49d5-a7d0-3ac8e9282b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:17.758633 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-f9644c87-9a4a-49d5-a7d0-3ac8e9282b47 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:17.761105 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-f9644c87-9a4a-49d5-a7d0-3ac8e9282b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:17.769410 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 530/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:07:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:18.181857 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70480e97-a956-4ec0-ab08-52e156653747 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:18.217421 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70480e97-a956-4ec0-ab08-52e156653747 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:18.222431 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7031d60-e58e-4b3d-bab2-33c076e2adcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:18.223500 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7031d60-e58e-4b3d-bab2-33c076e2adcd service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:18.223851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7031d60-e58e-4b3d-bab2-33c076e2adcd service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:18.224181 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7031d60-e58e-4b3d-bab2-33c076e2adcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:18.235386 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7031d60-e58e-4b3d-bab2-33c076e2adcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:18.237109 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7031d60-e58e-4b3d-bab2-33c076e2adcd service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:18.250326 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 533/1063] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:21.087219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e584d-7384-413f-96f1-38cf2beac4f6 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.087847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e584d-7384-413f-96f1-38cf2beac4f6 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.087847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e584d-7384-413f-96f1-38cf2beac4f6 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.089132 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 531/1064] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:21.095096 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e01b0-0955-487c-8485-4813746512e8 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.095721 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e01b0-0955-487c-8485-4813746512e8 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.095721 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e01b0-0955-487c-8485-4813746512e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.120299 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-4c8e01b0-0955-487c-8485-4813746512e8 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:21.121529 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-4c8e01b0-0955-487c-8485-4813746512e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:21.129573 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 534/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:07:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:21.496398 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e584d-7384-413f-96f1-38cf2beac4f6 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:21.507137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e584d-7384-413f-96f1-38cf2beac4f6 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:21.511442 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b7255-2062-4f92-8932-071695b10d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:21.512067 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b7255-2062-4f92-8932-071695b10d3c service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.512345 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b7255-2062-4f92-8932-071695b10d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.512615 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b7255-2062-4f92-8932-071695b10d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.522058 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b7255-2062-4f92-8932-071695b10d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:21.523807 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b7255-2062-4f92-8932-071695b10d3c service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:21.533620 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 532/1066] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:07:23.924998 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabec235-4a06-4543-ae7e-adbc74c19f2c None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:23.926041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabec235-4a06-4543-ae7e-adbc74c19f2c None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:23.926041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabec235-4a06-4543-ae7e-adbc74c19f2c None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:23.928172 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 535/1067] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:07:23.935137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6c6cb-c39f-46db-a165-4d2cb4c52799 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:23.936015 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6c6cb-c39f-46db-a165-4d2cb4c52799 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:23.936015 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6c6cb-c39f-46db-a165-4d2cb4c52799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:23.956622 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-19f6c6cb-c39f-46db-a165-4d2cb4c52799 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:23.957941 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-19f6c6cb-c39f-46db-a165-4d2cb4c52799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:23.966416 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 533/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:07:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:24.323065 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabec235-4a06-4543-ae7e-adbc74c19f2c None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:24.338454 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabec235-4a06-4543-ae7e-adbc74c19f2c None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:24.342802 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d296e6-6312-4225-bd12-3caf31677a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:24.343507 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d296e6-6312-4225-bd12-3caf31677a32 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:24.343795 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d296e6-6312-4225-bd12-3caf31677a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:24.344066 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d296e6-6312-4225-bd12-3caf31677a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:24.354579 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d296e6-6312-4225-bd12-3caf31677a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:24.356140 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d296e6-6312-4225-bd12-3caf31677a32 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:24.367417 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 536/1069] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:26.814882 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea7c83-f9fa-4c40-9797-1ed7f042d2e0 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:26.815507 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea7c83-f9fa-4c40-9797-1ed7f042d2e0 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:26.815507 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea7c83-f9fa-4c40-9797-1ed7f042d2e0 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:26.816816 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 534/1070] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:26.822363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061c49-ceb4-47c0-88dc-0b0d4133c758 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:26.823493 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061c49-ceb4-47c0-88dc-0b0d4133c758 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:26.823607 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061c49-ceb4-47c0-88dc-0b0d4133c758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:26.830919 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=61 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:26.843869 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-06061c49-ceb4-47c0-88dc-0b0d4133c758 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:26.845379 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-06061c49-ceb4-47c0-88dc-0b0d4133c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:26.853720 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 537/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:07:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:07:27.203758 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea7c83-f9fa-4c40-9797-1ed7f042d2e0 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:27.209278 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=64 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:27.216792 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea7c83-f9fa-4c40-9797-1ed7f042d2e0 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:27.220325 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e4ee7-25bf-4005-8c1d-26441c74f7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:27.220915 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e4ee7-25bf-4005-8c1d-26441c74f7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:27.221191 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e4ee7-25bf-4005-8c1d-26441c74f7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:27.221459 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e4ee7-25bf-4005-8c1d-26441c74f7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:27.230620 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e4ee7-25bf-4005-8c1d-26441c74f7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:27.232083 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e4ee7-25bf-4005-8c1d-26441c74f7d3 service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:27.241145 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 535/1072] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:29.572324 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765f9ae-497f-4266-b618-e2a06169daf5 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:29.573236 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765f9ae-497f-4266-b618-e2a06169daf5 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:29.573236 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765f9ae-497f-4266-b618-e2a06169daf5 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:29.575124 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 538/1073] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:29.583107 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdb0b9-2b96-4f60-a77d-61081e20dcb0 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:29.584015 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdb0b9-2b96-4f60-a77d-61081e20dcb0 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:29.584015 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdb0b9-2b96-4f60-a77d-61081e20dcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:29.618746 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-13cdb0b9-2b96-4f60-a77d-61081e20dcb0 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:29.621447 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-13cdb0b9-2b96-4f60-a77d-61081e20dcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:29.638992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 536/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:07:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:30.095153 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765f9ae-497f-4266-b618-e2a06169daf5 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:30.113958 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765f9ae-497f-4266-b618-e2a06169daf5 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:30.120339 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adb2b0-399b-4478-af71-0628c2f85320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:30.121253 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adb2b0-399b-4478-af71-0628c2f85320 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:30.121696 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adb2b0-399b-4478-af71-0628c2f85320 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:30.122127 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adb2b0-399b-4478-af71-0628c2f85320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:30.138600 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adb2b0-399b-4478-af71-0628c2f85320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:30.141218 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adb2b0-399b-4478-af71-0628c2f85320 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:30.160523 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 539/1075] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:33.136786 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67552b7b-c633-40e4-be03-658606d294a9 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.137391 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67552b7b-c633-40e4-be03-658606d294a9 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.137648 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67552b7b-c633-40e4-be03-658606d294a9 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.140221 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 537/1076] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:07:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:33.146484 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae70d2-3f5d-41de-9e8e-f132417e4062 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.147366 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae70d2-3f5d-41de-9e8e-f132417e4062 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.147529 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae70d2-3f5d-41de-9e8e-f132417e4062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.170388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-00ae70d2-3f5d-41de-9e8e-f132417e4062 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:33.171834 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-00ae70d2-3f5d-41de-9e8e-f132417e4062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:33.184126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 540/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:07:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:33.555158 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67552b7b-c633-40e4-be03-658606d294a9 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:33.570410 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67552b7b-c633-40e4-be03-658606d294a9 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:33.577432 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46086263-e8b8-4875-9b3e-effbe960e8a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:33.578417 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46086263-e8b8-4875-9b3e-effbe960e8a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.578899 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46086263-e8b8-4875-9b3e-effbe960e8a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.579415 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46086263-e8b8-4875-9b3e-effbe960e8a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.595694 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46086263-e8b8-4875-9b3e-effbe960e8a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:33.598157 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46086263-e8b8-4875-9b3e-effbe960e8a6 service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:33.616600 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 538/1078] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:07:36.038335 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d43f4-f78b-466a-bcd3-ee8299ee6dd4 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:36.038907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d43f4-f78b-466a-bcd3-ee8299ee6dd4 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:36.039033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d43f4-f78b-466a-bcd3-ee8299ee6dd4 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:36.041021 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 541/1079] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:07:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:36.046753 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2d7d7-a092-4f31-aaea-a13c877051b4 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:36.047248 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2d7d7-a092-4f31-aaea-a13c877051b4 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:36.047378 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2d7d7-a092-4f31-aaea-a13c877051b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:36.066931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-b4e2d7d7-a092-4f31-aaea-a13c877051b4 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:36.068175 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-b4e2d7d7-a092-4f31-aaea-a13c877051b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:36.076681 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 539/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:07:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:36.423465 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d43f4-f78b-466a-bcd3-ee8299ee6dd4 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:36.436715 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d43f4-f78b-466a-bcd3-ee8299ee6dd4 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:36.440873 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454d1d8-e038-487e-8b34-5144b6803299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:36.441482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454d1d8-e038-487e-8b34-5144b6803299 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:36.441760 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454d1d8-e038-487e-8b34-5144b6803299 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:36.442030 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454d1d8-e038-487e-8b34-5144b6803299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:36.454517 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454d1d8-e038-487e-8b34-5144b6803299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:36.456276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454d1d8-e038-487e-8b34-5144b6803299 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:36.467165 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 542/1081] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:39.057466 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8c4da-8b2c-4ddf-9cbe-ff29a4ae0524 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:39.058134 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8c4da-8b2c-4ddf-9cbe-ff29a4ae0524 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:39.058134 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8c4da-8b2c-4ddf-9cbe-ff29a4ae0524 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:39.059445 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 540/1082] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:39.066289 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c804a3-1388-4cb1-bfe0-5fc3655f3eaf None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:39.067243 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c804a3-1388-4cb1-bfe0-5fc3655f3eaf None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:39.067243 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c804a3-1388-4cb1-bfe0-5fc3655f3eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:39.094291 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-15c804a3-1388-4cb1-bfe0-5fc3655f3eaf None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:39.095569 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-15c804a3-1388-4cb1-bfe0-5fc3655f3eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:39.103919 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 543/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:07:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:39.483070 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8c4da-8b2c-4ddf-9cbe-ff29a4ae0524 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:39.495025 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8c4da-8b2c-4ddf-9cbe-ff29a4ae0524 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:39.499906 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8267b3-d770-4589-adfd-1777cca08110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:39.500520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8267b3-d770-4589-adfd-1777cca08110 service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:39.500798 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8267b3-d770-4589-adfd-1777cca08110 service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:39.501072 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8267b3-d770-4589-adfd-1777cca08110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:39.512600 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8267b3-d770-4589-adfd-1777cca08110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:39.514273 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8267b3-d770-4589-adfd-1777cca08110 service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:39.526572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 541/1084] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:07:42.010751 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144c755-5186-4ed1-8827-f1d14a700d9f None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.011564 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144c755-5186-4ed1-8827-f1d14a700d9f None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.011564 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144c755-5186-4ed1-8827-f1d14a700d9f None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.012851 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 544/1085] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:07:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:42.020367 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aba0b4-a19f-4b7b-8d02-4aea5fcd5938 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.020945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aba0b4-a19f-4b7b-8d02-4aea5fcd5938 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.020945 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aba0b4-a19f-4b7b-8d02-4aea5fcd5938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.042303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-23aba0b4-a19f-4b7b-8d02-4aea5fcd5938 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:42.044206 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-23aba0b4-a19f-4b7b-8d02-4aea5fcd5938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:42.052690 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 542/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:07:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:42.409563 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144c755-5186-4ed1-8827-f1d14a700d9f None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:42.421305 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144c755-5186-4ed1-8827-f1d14a700d9f None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:42.425132 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a1a51-1bb8-4ddf-a6b5-0ddcf67a3152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:42.425875 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a1a51-1bb8-4ddf-a6b5-0ddcf67a3152 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.426318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a1a51-1bb8-4ddf-a6b5-0ddcf67a3152 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.426688 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a1a51-1bb8-4ddf-a6b5-0ddcf67a3152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.437752 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a1a51-1bb8-4ddf-a6b5-0ddcf67a3152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:42.439488 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a1a51-1bb8-4ddf-a6b5-0ddcf67a3152 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:42.452311 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 545/1087] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:07:52.036353 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=26 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:52.446432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=26 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:08.803595 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4c1bb-f3c7-4105-8bdc-bce7c9c686b1 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:08.804268 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4c1bb-f3c7-4105-8bdc-bce7c9c686b1 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:08.804502 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4c1bb-f3c7-4105-8bdc-bce7c9c686b1 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:08.807022 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 543/1088] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:08:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:08:08.814301 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f6676-f217-4e91-bf4c-bb00d7dc940a None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:08.814879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f6676-f217-4e91-bf4c-bb00d7dc940a None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:08.814879 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f6676-f217-4e91-bf4c-bb00d7dc940a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:08.836355 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-a38f6676-f217-4e91-bf4c-bb00d7dc940a None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:08.837698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-a38f6676-f217-4e91-bf4c-bb00d7dc940a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:08.846363 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 546/1089] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:08:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:09.221598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f357e-6112-4e20-a5b4-5a170fffe92b None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:09.222046 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f357e-6112-4e20-a5b4-5a170fffe92b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:09.222556 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f357e-6112-4e20-a5b4-5a170fffe92b None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:09.225015 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 544/1090] 10.222.0.16 () {54 vars in 967 bytes} [Thu Aug 18 21:08:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:08:09.233384 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20851970-20df-4865-9df5-1225932c41a9 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:09.233668 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20851970-20df-4865-9df5-1225932c41a9 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:09.233946 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20851970-20df-4865-9df5-1225932c41a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:09.257105 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-20851970-20df-4865-9df5-1225932c41a9 None None] MFA Rules not processed for user `255b174cea9f41f6970978c44bec2b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:09.259171 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-20851970-20df-4865-9df5-1225932c41a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:09.268646 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 547/1091] 10.222.0.16 () {58 vars in 1064 bytes} [Thu Aug 18 21:08:09 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:09.276765 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f357e-6112-4e20-a5b4-5a170fffe92b None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:09.289393 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f357e-6112-4e20-a5b4-5a170fffe92b None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:09.293515 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15318c51-de96-4577-82ad-7b6c961dfa1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255b174cea9f41f6970978c44bec2b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:09.294497 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15318c51-de96-4577-82ad-7b6c961dfa1b service glance] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:09.294847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15318c51-de96-4577-82ad-7b6c961dfa1b service glance] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:09.295159 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15318c51-de96-4577-82ad-7b6c961dfa1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:09.308598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15318c51-de96-4577-82ad-7b6c961dfa1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:09.310960 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15318c51-de96-4577-82ad-7b6c961dfa1b service glance] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:09.322369 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 545/1092] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:08:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:08:11.910339 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814765b-a905-40b6-ba48-4259c51cfeb9 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:11.910917 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814765b-a905-40b6-ba48-4259c51cfeb9 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:11.911155 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814765b-a905-40b6-ba48-4259c51cfeb9 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:11.913685 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 548/1093] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:08:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:08:11.920123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6e8e-7fd9-4b7f-a3de-87399b7c9397 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:11.920762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6e8e-7fd9-4b7f-a3de-87399b7c9397 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:11.920762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6e8e-7fd9-4b7f-a3de-87399b7c9397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:11.943230 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-d99d6e8e-7fd9-4b7f-a3de-87399b7c9397 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:11.944516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-d99d6e8e-7fd9-4b7f-a3de-87399b7c9397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:11.953604 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 546/1094] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:08:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:12.297160 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814765b-a905-40b6-ba48-4259c51cfeb9 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:12.311536 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814765b-a905-40b6-ba48-4259c51cfeb9 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:12.318351 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc22d1-c33b-4c57-8176-5145bcf10c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:12.319032 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc22d1-c33b-4c57-8176-5145bcf10c83 admin admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:12.319529 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc22d1-c33b-4c57-8176-5145bcf10c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:12.319997 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc22d1-c33b-4c57-8176-5145bcf10c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:12.320895 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc22d1-c33b-4c57-8176-5145bcf10c83 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:12.323773 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: WARNING py.warnings [None req-4dcc22d1-c33b-4c57-8176-5145bcf10c83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:08:12.323773 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: warnings.warn(msg) Aug 18 21:08:12.323773 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: Aug 18 21:08:12.326067 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc22d1-c33b-4c57-8176-5145bcf10c83 admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:12.348197 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 549/1095] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Aug 18 21:08:12 2022] GET /identity/v3/projects => generated 1606 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:08:14.720466 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225f44c-7f1d-47ea-a4e7-f86eff7db6bb None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:14.721190 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225f44c-7f1d-47ea-a4e7-f86eff7db6bb None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:14.721190 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225f44c-7f1d-47ea-a4e7-f86eff7db6bb None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:14.722427 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 547/1096] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:08:14.728547 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2b52d-3149-4085-afb7-ef45753f5fa9 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:14.729376 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2b52d-3149-4085-afb7-ef45753f5fa9 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:14.729376 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2b52d-3149-4085-afb7-ef45753f5fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:14.752580 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-cfd2b52d-3149-4085-afb7-ef45753f5fa9 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:14.753828 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-cfd2b52d-3149-4085-afb7-ef45753f5fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:14.762149 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 550/1097] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:08:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:08:15.121775 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225f44c-7f1d-47ea-a4e7-f86eff7db6bb None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:15.142931 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225f44c-7f1d-47ea-a4e7-f86eff7db6bb None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:15.156319 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9a35b-223b-4079-8915-703ae0cdc25a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:15.158537 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9a35b-223b-4079-8915-703ae0cdc25a service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:15.159040 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9a35b-223b-4079-8915-703ae0cdc25a service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:15.159426 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9a35b-223b-4079-8915-703ae0cdc25a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:15.169709 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9a35b-223b-4079-8915-703ae0cdc25a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:15.171513 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9a35b-223b-4079-8915-703ae0cdc25a service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:15.182926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 548/1098] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:08:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:08:17.821388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09b6f9-7a41-406e-9fcf-e89f07ab1327 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:17.821954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09b6f9-7a41-406e-9fcf-e89f07ab1327 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:17.821954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09b6f9-7a41-406e-9fcf-e89f07ab1327 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:17.823335 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 551/1099] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:08:17.829650 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52b9d0-8be2-4ae4-bcac-fb9fe04b5dd9 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:17.830528 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52b9d0-8be2-4ae4-bcac-fb9fe04b5dd9 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:17.830528 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52b9d0-8be2-4ae4-bcac-fb9fe04b5dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:17.850665 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-4e52b9d0-8be2-4ae4-bcac-fb9fe04b5dd9 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:17.851911 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-4e52b9d0-8be2-4ae4-bcac-fb9fe04b5dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:17.861620 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 549/1100] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:08:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:08:18.233222 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09b6f9-7a41-406e-9fcf-e89f07ab1327 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:18.249866 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09b6f9-7a41-406e-9fcf-e89f07ab1327 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:18.255450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250ebb5-37bc-434f-9fb5-3738c6418c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:18.256471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ebb5-37bc-434f-9fb5-3738c6418c3e service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:18.256953 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ebb5-37bc-434f-9fb5-3738c6418c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:18.257417 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ebb5-37bc-434f-9fb5-3738c6418c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:18.274254 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250ebb5-37bc-434f-9fb5-3738c6418c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:18.276968 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250ebb5-37bc-434f-9fb5-3738c6418c3e service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:18.296334 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 552/1101] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:08:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:08:20.823492 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8715be-56ed-4b10-ab6b-d81b985b7603 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:20.824152 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8715be-56ed-4b10-ab6b-d81b985b7603 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:20.824494 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8715be-56ed-4b10-ab6b-d81b985b7603 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:20.827136 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 550/1102] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:08:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:08:20.834476 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e198c26-aa35-485b-b356-14548563b3f4 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:20.835193 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e198c26-aa35-485b-b356-14548563b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:20.835193 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e198c26-aa35-485b-b356-14548563b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:20.861124 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-8e198c26-aa35-485b-b356-14548563b3f4 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:20.862378 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-8e198c26-aa35-485b-b356-14548563b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:20.873207 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 553/1103] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:08:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:08:21.409424 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8715be-56ed-4b10-ab6b-d81b985b7603 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:21.427247 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8715be-56ed-4b10-ab6b-d81b985b7603 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:21.433572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0aa78-91ac-4354-89d7-269e304906dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:21.434814 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0aa78-91ac-4354-89d7-269e304906dd service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:21.435923 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0aa78-91ac-4354-89d7-269e304906dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:21.436619 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0aa78-91ac-4354-89d7-269e304906dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:21.455118 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0aa78-91ac-4354-89d7-269e304906dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:21.458584 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0aa78-91ac-4354-89d7-269e304906dd service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:21.480439 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 551/1104] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:08:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:08:24.150604 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219577e-e333-4a7d-b469-3e54a065804a None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:24.151367 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219577e-e333-4a7d-b469-3e54a065804a None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:24.151367 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219577e-e333-4a7d-b469-3e54a065804a None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:24.152599 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 554/1105] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:08:24.160328 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9f4e4-f216-45cb-be48-055a9a1400b7 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:24.160921 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9f4e4-f216-45cb-be48-055a9a1400b7 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:24.160921 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9f4e4-f216-45cb-be48-055a9a1400b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:24.182845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-68e9f4e4-f216-45cb-be48-055a9a1400b7 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:24.185030 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-68e9f4e4-f216-45cb-be48-055a9a1400b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:24.198258 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 552/1106] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:08:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:24.586319 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219577e-e333-4a7d-b469-3e54a065804a None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:24.601346 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219577e-e333-4a7d-b469-3e54a065804a None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:24.608786 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e942b-1746-4c89-866c-bd10f58fc972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:24.609429 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e942b-1746-4c89-866c-bd10f58fc972 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:24.609902 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e942b-1746-4c89-866c-bd10f58fc972 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:24.610385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e942b-1746-4c89-866c-bd10f58fc972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:24.627798 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e942b-1746-4c89-866c-bd10f58fc972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:24.630424 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e942b-1746-4c89-866c-bd10f58fc972 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:24.644688 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 555/1107] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:08:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:08:27.348189 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edc7bd-a7d2-434d-953c-f49b293b22f1 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:27.348784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edc7bd-a7d2-434d-953c-f49b293b22f1 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:27.349144 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edc7bd-a7d2-434d-953c-f49b293b22f1 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:27.351306 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 553/1108] 10.222.0.16 () {54 vars in 927 bytes} [Thu Aug 18 21:08:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:08:27.357926 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8d7b2-404b-49b2-a52d-6b7946684512 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:27.359784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8d7b2-404b-49b2-a52d-6b7946684512 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:27.359784 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8d7b2-404b-49b2-a52d-6b7946684512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:27.379179 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-c9f8d7b2-404b-49b2-a52d-6b7946684512 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:27.380440 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-c9f8d7b2-404b-49b2-a52d-6b7946684512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:27.389441 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 556/1109] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Aug 18 21:08:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:27.746156 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edc7bd-a7d2-434d-953c-f49b293b22f1 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:27.759058 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edc7bd-a7d2-434d-953c-f49b293b22f1 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:27.762668 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9d559-954e-40c5-b0e4-7a3aae07dbab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:27.763302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d559-954e-40c5-b0e4-7a3aae07dbab service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:27.764135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d559-954e-40c5-b0e4-7a3aae07dbab service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:27.764499 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d559-954e-40c5-b0e4-7a3aae07dbab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:27.780657 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9d559-954e-40c5-b0e4-7a3aae07dbab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:27.785689 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9d559-954e-40c5-b0e4-7a3aae07dbab service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:27.801892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 554/1110] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:08:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:08:37.373742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=33 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:37.793886 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=33 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:51.157590 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8a0ba-413d-4bd2-935b-b4cb089904d9 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:51.158247 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8a0ba-413d-4bd2-935b-b4cb089904d9 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:51.158247 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8a0ba-413d-4bd2-935b-b4cb089904d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:51.180729 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-e4d8a0ba-413d-4bd2-935b-b4cb089904d9 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:51.182126 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-e4d8a0ba-413d-4bd2-935b-b4cb089904d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:51.191434 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 557/1111] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:09:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:09:51.205637 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96221f08-3c03-4652-ba83-40b9dcdf740b None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:51.206544 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96221f08-3c03-4652-ba83-40b9dcdf740b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:51.206544 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96221f08-3c03-4652-ba83-40b9dcdf740b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:51.235927 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-96221f08-3c03-4652-ba83-40b9dcdf740b None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:51.237068 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-96221f08-3c03-4652-ba83-40b9dcdf740b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:51.245521 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 555/1112] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:09:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:09:51.251455 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8a0ba-413d-4bd2-935b-b4cb089904d9 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:51.262299 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8a0ba-413d-4bd2-935b-b4cb089904d9 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:51.270244 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec883d8-425f-4ab9-966b-f8038d10adc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:51.270907 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec883d8-425f-4ab9-966b-f8038d10adc1 admin admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:51.271193 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec883d8-425f-4ab9-966b-f8038d10adc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:51.271570 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec883d8-425f-4ab9-966b-f8038d10adc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:51.272463 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec883d8-425f-4ab9-966b-f8038d10adc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:09:51.272822 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec883d8-425f-4ab9-966b-f8038d10adc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:51.273982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: WARNING py.warnings [None req-5ec883d8-425f-4ab9-966b-f8038d10adc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:51.273982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: warnings.warn(msg) Aug 18 21:09:51.273982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: Aug 18 21:09:51.274876 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec883d8-425f-4ab9-966b-f8038d10adc1 admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:51.289742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 558/1113] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Aug 18 21:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:09:51.298479 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96221f08-3c03-4652-ba83-40b9dcdf740b None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:51.310420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96221f08-3c03-4652-ba83-40b9dcdf740b None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:51.319093 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc8209-6a29-4a23-8723-15fc9819cbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:51.319894 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8209-6a29-4a23-8723-15fc9819cbba admin admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:51.320303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8209-6a29-4a23-8723-15fc9819cbba admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:51.320656 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8209-6a29-4a23-8723-15fc9819cbba admin admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:51.321365 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc8209-6a29-4a23-8723-15fc9819cbba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:51.323410 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: WARNING py.warnings [None req-2ffc8209-6a29-4a23-8723-15fc9819cbba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:51.323410 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: warnings.warn(msg) Aug 18 21:09:51.323410 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: Aug 18 21:09:51.324818 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc8209-6a29-4a23-8723-15fc9819cbba admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:51.361998 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 556/1114] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Aug 18 21:09:51 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:09:51.369339 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec883d8-425f-4ab9-966b-f8038d10adc1 admin admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:51.380745 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec883d8-425f-4ab9-966b-f8038d10adc1 admin admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:51.453254 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af98d3-b6dd-4f47-a737-37093467024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:51.454293 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af98d3-b6dd-4f47-a737-37093467024b admin admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:51.454790 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af98d3-b6dd-4f47-a737-37093467024b admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:51.455312 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af98d3-b6dd-4f47-a737-37093467024b admin admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:51.456606 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af98d3-b6dd-4f47-a737-37093467024b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:51.458271 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: WARNING py.warnings [None req-b0af98d3-b6dd-4f47-a737-37093467024b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:51.458271 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: warnings.warn(msg) Aug 18 21:09:51.458271 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: Aug 18 21:09:51.460055 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af98d3-b6dd-4f47-a737-37093467024b admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:51.491562 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 559/1115] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Aug 18 21:09:51 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:09:51.496357 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc8209-6a29-4a23-8723-15fc9819cbba admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:51.511142 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc8209-6a29-4a23-8723-15fc9819cbba admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:51.516262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7cd0-c6d3-4040-b271-dea2cc737ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:51.516878 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7cd0-c6d3-4040-b271-dea2cc737ddf admin admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:51.517157 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7cd0-c6d3-4040-b271-dea2cc737ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:51.517436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7cd0-c6d3-4040-b271-dea2cc737ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:51.518084 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e7cd0-c6d3-4040-b271-dea2cc737ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:51.519114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: WARNING py.warnings [None req-6f3e7cd0-c6d3-4040-b271-dea2cc737ddf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:51.519114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: warnings.warn(msg) Aug 18 21:09:51.519114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: Aug 18 21:09:51.520057 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e7cd0-c6d3-4040-b271-dea2cc737ddf admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:51.534599 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 557/1116] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Aug 18 21:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:09:51.540747 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af98d3-b6dd-4f47-a737-37093467024b admin admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:51.555490 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af98d3-b6dd-4f47-a737-37093467024b admin admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:51.563331 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3941e26-a5eb-4de4-ab56-adf1c516a03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:51.563963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3941e26-a5eb-4de4-ab56-adf1c516a03b admin admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:51.564276 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3941e26-a5eb-4de4-ab56-adf1c516a03b admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:51.564573 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3941e26-a5eb-4de4-ab56-adf1c516a03b admin admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:51.565705 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3941e26-a5eb-4de4-ab56-adf1c516a03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:51.566892 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: WARNING py.warnings [None req-a3941e26-a5eb-4de4-ab56-adf1c516a03b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:51.566892 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: warnings.warn(msg) Aug 18 21:09:51.566892 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: Aug 18 21:09:51.567814 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3941e26-a5eb-4de4-ab56-adf1c516a03b admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:51.582860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 560/1117] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Aug 18 21:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:09:51.588074 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7cd0-c6d3-4040-b271-dea2cc737ddf admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:51.602153 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7cd0-c6d3-4040-b271-dea2cc737ddf admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:51.607289 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b4239-ba86-4d4f-9f55-1d7bf788e51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:51.608017 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b4239-ba86-4d4f-9f55-1d7bf788e51c admin admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:51.608336 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b4239-ba86-4d4f-9f55-1d7bf788e51c admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:51.608748 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b4239-ba86-4d4f-9f55-1d7bf788e51c admin admin] PATH_INFO: `/v3/projects/1ffadfab82d441e48cc72b0dbba3584b/users/4f801630dc83469da855c55c10d870b5/roles/70cebcd047db4003b7016de5c93cab80` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:51.627381 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b4239-ba86-4d4f-9f55-1d7bf788e51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffadfab82d441e48cc72b0dbba3584b, user_id=4f801630dc83469da855c55c10d870b5, role_id=70cebcd047db4003b7016de5c93cab80)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:51.629271 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: WARNING py.warnings [None req-094b4239-ba86-4d4f-9f55-1d7bf788e51c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:51.629271 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: warnings.warn(msg) Aug 18 21:09:51.629271 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: Aug 18 21:09:51.633239 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b4239-ba86-4d4f-9f55-1d7bf788e51c admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:51.672177 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 558/1118] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Aug 18 21:09:51 2022] PUT /identity/v3/projects/1ffadfab82d441e48cc72b0dbba3584b/users/4f801630dc83469da855c55c10d870b5/roles/70cebcd047db4003b7016de5c93cab80 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:09:51.684664 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f19f-c99b-4ceb-8ddb-95f8105e8a0c None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:51.684967 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f19f-c99b-4ceb-8ddb-95f8105e8a0c None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:51.685185 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f19f-c99b-4ceb-8ddb-95f8105e8a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:51.721407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-b4f9f19f-c99b-4ceb-8ddb-95f8105e8a0c None None] MFA Rules not processed for user `4f801630dc83469da855c55c10d870b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:51.722699 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-b4f9f19f-c99b-4ceb-8ddb-95f8105e8a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:51.810589 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 561/1119] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:09:51 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:09:51.826482 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aaa75-4c55-4d15-9372-910e44e4994c None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:51.826761 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aaa75-4c55-4d15-9372-910e44e4994c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:51.827038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aaa75-4c55-4d15-9372-910e44e4994c None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:51.829081 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 559/1120] 10.222.0.16 () {54 vars in 964 bytes} [Thu Aug 18 21:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:09:51.836208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed8a46-b6db-46ea-a829-03abf1b42af4 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:51.836621 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed8a46-b6db-46ea-a829-03abf1b42af4 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:51.837033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed8a46-b6db-46ea-a829-03abf1b42af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:51.867202 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-caed8a46-b6db-46ea-a829-03abf1b42af4 None None] MFA Rules not processed for user `3510dd48a215455fb55bfbec820c7f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:51.869268 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-caed8a46-b6db-46ea-a829-03abf1b42af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:51.927069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:51.936250 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 562/1121] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Aug 18 21:09:51 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:09:51.945906 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074aaa75-4c55-4d15-9372-910e44e4994c None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:51.958572 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074aaa75-4c55-4d15-9372-910e44e4994c None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:51.962415 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3d280-2fa8-4043-84d7-458b4af8d0f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3510dd48a215455fb55bfbec820c7f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:51.963023 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3d280-2fa8-4043-84d7-458b4af8d0f4 service cinder] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:51.963360 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3d280-2fa8-4043-84d7-458b4af8d0f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:51.963614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3d280-2fa8-4043-84d7-458b4af8d0f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:51.983685 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3d280-2fa8-4043-84d7-458b4af8d0f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:51.987043 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3d280-2fa8-4043-84d7-458b4af8d0f4 service cinder] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:51.998346 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 560/1122] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:09:51 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:09:52.052650 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a885-d31a-44d8-bc7a-622da25c1397 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:52.053007 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a885-d31a-44d8-bc7a-622da25c1397 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:52.053154 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a885-d31a-44d8-bc7a-622da25c1397 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:52.054964 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 563/1123] 10.222.0.16 () {52 vars in 830 bytes} [Thu Aug 18 21:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:09:52.060510 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3d280-2fa8-4043-84d7-458b4af8d0f4 service cinder] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:52.151382 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3d280-2fa8-4043-84d7-458b4af8d0f4 service cinder] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:52.156404 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:52.157097 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:52.157419 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:52.157737 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] PATH_INFO: `/v3/users/4f801630dc83469da855c55c10d870b5` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:52.159100 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f801630dc83469da855c55c10d870b5)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:52.160244 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: WARNING py.warnings [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:52.160244 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: warnings.warn(msg) Aug 18 21:09:52.160244 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: Aug 18 21:09:52.161598 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:52.259640 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f801630dc83469da855c55c10d870b5'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:52.300444 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f801630dc83469da855c55c10d870b5'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:52.301549 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f801630dc83469da855c55c10d870b5'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:52.323299 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f801630dc83469da855c55c10d870b5'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:52.339548 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f801630dc83469da855c55c10d870b5'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:52.347212 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 561/1124] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Aug 18 21:09:52 2022] DELETE /identity/v3/users/4f801630dc83469da855c55c10d870b5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:09:52.356727 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65c8eb-184b-4737-9dac-6608b2522998 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:52.357327 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65c8eb-184b-4737-9dac-6608b2522998 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:52.357493 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65c8eb-184b-4737-9dac-6608b2522998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:52.381089 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-8a65c8eb-184b-4737-9dac-6608b2522998 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:52.382364 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-8a65c8eb-184b-4737-9dac-6608b2522998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:52.456575 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 564/1125] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:09:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:09:52.467663 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:52.469692 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:52.478853 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:52.543627 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca68a46-2200-41df-92a2-b877ef0a0c9e admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:52.548328 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c19b9-99af-4cd2-bd8f-051ceebef6f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:52.549036 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c19b9-99af-4cd2-bd8f-051ceebef6f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:52.549316 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c19b9-99af-4cd2-bd8f-051ceebef6f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:52.549589 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c19b9-99af-4cd2-bd8f-051ceebef6f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:52.561495 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c19b9-99af-4cd2-bd8f-051ceebef6f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:52.564366 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c19b9-99af-4cd2-bd8f-051ceebef6f2 service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:52.583036 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 562/1126] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:09:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:09:53.056413 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65c8eb-184b-4737-9dac-6608b2522998 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:53.058525 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-8a65c8eb-184b-4737-9dac-6608b2522998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:53.072717 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65c8eb-184b-4737-9dac-6608b2522998 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:53.078423 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552385a3-ef01-45a4-baf7-a95696985bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:53.079370 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552385a3-ef01-45a4-baf7-a95696985bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:53.079675 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552385a3-ef01-45a4-baf7-a95696985bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:53.080055 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552385a3-ef01-45a4-baf7-a95696985bfd admin admin] PATH_INFO: `/v3/projects/1ffadfab82d441e48cc72b0dbba3584b` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:53.081578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552385a3-ef01-45a4-baf7-a95696985bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ffadfab82d441e48cc72b0dbba3584b)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:53.082680 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: WARNING py.warnings [None req-552385a3-ef01-45a4-baf7-a95696985bfd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:53.082680 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: warnings.warn(msg) Aug 18 21:09:53.082680 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: Aug 18 21:09:53.084386 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552385a3-ef01-45a4-baf7-a95696985bfd admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:53.161381 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-552385a3-ef01-45a4-baf7-a95696985bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ffadfab82d441e48cc72b0dbba3584b', 'request_id': 'req-552385a3-ef01-45a4-baf7-a95696985bfd'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:53.177092 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-552385a3-ef01-45a4-baf7-a95696985bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ffadfab82d441e48cc72b0dbba3584b', 'request_id': 'req-552385a3-ef01-45a4-baf7-a95696985bfd'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:53.203675 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-552385a3-ef01-45a4-baf7-a95696985bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ffadfab82d441e48cc72b0dbba3584b', 'request_id': 'req-552385a3-ef01-45a4-baf7-a95696985bfd'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:53.222919 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-552385a3-ef01-45a4-baf7-a95696985bfd admin admin] The token cache is being invalidate because project 1ffadfab82d441e48cc72b0dbba3584b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:09:53.223487 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-552385a3-ef01-45a4-baf7-a95696985bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:53.224766 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-552385a3-ef01-45a4-baf7-a95696985bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:53.227535 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 565/1127] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Aug 18 21:09:53 2022] DELETE /identity/v3/projects/1ffadfab82d441e48cc72b0dbba3584b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:10:02.574789 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=25 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:03.217472 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:20.522942 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092f196-5805-4735-bc3f-7f694db8cdcc None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:20.523639 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092f196-5805-4735-bc3f-7f694db8cdcc None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:20.523846 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092f196-5805-4735-bc3f-7f694db8cdcc None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:20.526135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 563/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:11:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:20.532339 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f015be-67fd-47c3-bca7-79e2cb8c97c0 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:20.532860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f015be-67fd-47c3-bca7-79e2cb8c97c0 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:20.532969 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f015be-67fd-47c3-bca7-79e2cb8c97c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:20.620644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-70f015be-67fd-47c3-bca7-79e2cb8c97c0 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:20.622310 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-70f015be-67fd-47c3-bca7-79e2cb8c97c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:20.760318 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 566/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:11:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:11:20.923478 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092f196-5805-4735-bc3f-7f694db8cdcc None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:20.925256 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-9092f196-5805-4735-bc3f-7f694db8cdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:21.027887 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092f196-5805-4735-bc3f-7f694db8cdcc None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:21.034000 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50ef42-9bc9-477e-91e6-dcd8b7d67466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:21.034843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50ef42-9bc9-477e-91e6-dcd8b7d67466 service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:21.035351 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50ef42-9bc9-477e-91e6-dcd8b7d67466 service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:21.035705 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50ef42-9bc9-477e-91e6-dcd8b7d67466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:21.045139 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50ef42-9bc9-477e-91e6-dcd8b7d67466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:21.047207 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50ef42-9bc9-477e-91e6-dcd8b7d67466 service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:21.058169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 564/1130] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:21.949778 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015410ee-d852-4e9b-8eb8-a62796179f8e None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:21.950598 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015410ee-d852-4e9b-8eb8-a62796179f8e None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:21.950598 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015410ee-d852-4e9b-8eb8-a62796179f8e None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:21.952444 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 567/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:21.960918 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350ca3a-e4df-4a6f-a28a-ad0b5b33f5e3 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:21.961665 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350ca3a-e4df-4a6f-a28a-ad0b5b33f5e3 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:21.961880 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350ca3a-e4df-4a6f-a28a-ad0b5b33f5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:21.994167 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-b350ca3a-e4df-4a6f-a28a-ad0b5b33f5e3 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:21.996144 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-b350ca3a-e4df-4a6f-a28a-ad0b5b33f5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:22.008790 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 565/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:11:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:22.180899 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015410ee-d852-4e9b-8eb8-a62796179f8e None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:22.194936 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015410ee-d852-4e9b-8eb8-a62796179f8e None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:22.200647 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f0bf6-f4fd-4cb3-bfc3-8af0fc52285e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:22.201254 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f0bf6-f4fd-4cb3-bfc3-8af0fc52285e service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:22.201527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f0bf6-f4fd-4cb3-bfc3-8af0fc52285e service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:22.201803 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f0bf6-f4fd-4cb3-bfc3-8af0fc52285e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:22.211353 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f0bf6-f4fd-4cb3-bfc3-8af0fc52285e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:22.213183 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f0bf6-f4fd-4cb3-bfc3-8af0fc52285e service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:22.224574 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 568/1133] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:25.888702 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b116d02-781b-4808-a961-343953e0cfd1 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:25.889436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b116d02-781b-4808-a961-343953e0cfd1 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:25.889436 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b116d02-781b-4808-a961-343953e0cfd1 None None] PATH_INFO: `/v3` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:25.891130 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 566/1134] 10.222.0.64 () {54 vars in 925 bytes} [Thu Aug 18 21:11:25 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:11:25.897287 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272775-c633-4fc3-89f2-6d45e4fdf049 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:25.897811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272775-c633-4fc3-89f2-6d45e4fdf049 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:25.897909 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272775-c633-4fc3-89f2-6d45e4fdf049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:25.932271 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-58272775-c633-4fc3-89f2-6d45e4fdf049 None None] MFA Rules not processed for user `42119f8b3cd5446ea7aca396ad1a0f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:25.933551 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-58272775-c633-4fc3-89f2-6d45e4fdf049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:25.998600 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:26.008897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 569/1135] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Aug 18 21:11:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:31.986957 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=42 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:33.494909 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2102e-28da-49c0-b40a-d324769c2099 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:33.495575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2102e-28da-49c0-b40a-d324769c2099 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:33.495575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2102e-28da-49c0-b40a-d324769c2099 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:33.496764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 567/1136] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:33.502544 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c780a-ef55-47e3-be4d-c6ddc79f4def None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:33.502999 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c780a-ef55-47e3-be4d-c6ddc79f4def None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:33.503112 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c780a-ef55-47e3-be4d-c6ddc79f4def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:33.523225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-944c780a-ef55-47e3-be4d-c6ddc79f4def None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:33.524468 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-944c780a-ef55-47e3-be4d-c6ddc79f4def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:33.532395 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 570/1137] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:11:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:33.696104 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2102e-28da-49c0-b40a-d324769c2099 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:33.716861 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2102e-28da-49c0-b40a-d324769c2099 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:33.724835 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986d05b-c837-4a27-92cd-827b611424a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:33.725849 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986d05b-c837-4a27-92cd-827b611424a6 service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:33.726343 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986d05b-c837-4a27-92cd-827b611424a6 service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:33.726827 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986d05b-c837-4a27-92cd-827b611424a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:33.741664 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986d05b-c837-4a27-92cd-827b611424a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:33.744220 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986d05b-c837-4a27-92cd-827b611424a6 service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:33.761032 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 568/1138] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:34.605173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268ddc9-e16a-4208-9244-02da62592654 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:34.606779 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268ddc9-e16a-4208-9244-02da62592654 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:34.606779 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268ddc9-e16a-4208-9244-02da62592654 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:34.608187 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 571/1139] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:11:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:34.613504 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2af13-7899-4ff8-a8ae-d37630a68ee7 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:34.613956 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2af13-7899-4ff8-a8ae-d37630a68ee7 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:34.614332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2af13-7899-4ff8-a8ae-d37630a68ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:34.636077 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-2fc2af13-7899-4ff8-a8ae-d37630a68ee7 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:34.637278 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-2fc2af13-7899-4ff8-a8ae-d37630a68ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:34.645852 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 569/1140] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:11:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:34.810699 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268ddc9-e16a-4208-9244-02da62592654 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:34.827707 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268ddc9-e16a-4208-9244-02da62592654 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:34.832445 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920dc95-32d8-4c23-829a-ea4d714f9d92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:34.833047 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920dc95-32d8-4c23-829a-ea4d714f9d92 service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:34.833331 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920dc95-32d8-4c23-829a-ea4d714f9d92 service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:34.833595 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920dc95-32d8-4c23-829a-ea4d714f9d92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:34.842824 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920dc95-32d8-4c23-829a-ea4d714f9d92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:34.846232 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920dc95-32d8-4c23-829a-ea4d714f9d92 service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:34.860465 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 572/1141] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:35.273874 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2396466-34ea-40d0-a0c3-1695ba7db9ef None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:35.274302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2396466-34ea-40d0-a0c3-1695ba7db9ef None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:35.274594 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2396466-34ea-40d0-a0c3-1695ba7db9ef None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:35.275979 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 570/1142] 10.222.0.16 () {54 vars in 961 bytes} [Thu Aug 18 21:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:11:35.284540 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cae000-7d02-48ec-b342-2df30175ce6f None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:35.285029 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cae000-7d02-48ec-b342-2df30175ce6f None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:35.285523 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cae000-7d02-48ec-b342-2df30175ce6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:35.309027 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-f9cae000-7d02-48ec-b342-2df30175ce6f None None] MFA Rules not processed for user `42119f8b3cd5446ea7aca396ad1a0f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:35.310548 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-f9cae000-7d02-48ec-b342-2df30175ce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:35.319536 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 573/1143] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Aug 18 21:11:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:35.391378 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2396466-34ea-40d0-a0c3-1695ba7db9ef None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:35.408845 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2396466-34ea-40d0-a0c3-1695ba7db9ef None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:35.413754 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929ab4a-dbaf-4f03-896f-e15c70ca4b90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42119f8b3cd5446ea7aca396ad1a0f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:35.414532 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929ab4a-dbaf-4f03-896f-e15c70ca4b90 service placement] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:35.414916 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929ab4a-dbaf-4f03-896f-e15c70ca4b90 service placement] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:35.415425 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929ab4a-dbaf-4f03-896f-e15c70ca4b90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:35.425053 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929ab4a-dbaf-4f03-896f-e15c70ca4b90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:35.426784 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929ab4a-dbaf-4f03-896f-e15c70ca4b90 service placement] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:35.437372 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 571/1144] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:35 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:39.400564 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e12336-a767-475b-b9b6-770d88c4b953 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:39.401098 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e12336-a767-475b-b9b6-770d88c4b953 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:39.401098 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e12336-a767-475b-b9b6-770d88c4b953 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:39.402340 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 574/1145] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:39.408780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146047e-072f-4433-9dfc-7131908e5b2c None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:39.409254 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146047e-072f-4433-9dfc-7131908e5b2c None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:39.409384 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146047e-072f-4433-9dfc-7131908e5b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:39.432971 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-b146047e-072f-4433-9dfc-7131908e5b2c None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:39.434605 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-b146047e-072f-4433-9dfc-7131908e5b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:39.444393 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 572/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:11:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:39.807900 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e12336-a767-475b-b9b6-770d88c4b953 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:39.809661 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-72e12336-a767-475b-b9b6-770d88c4b953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:39.881075 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e12336-a767-475b-b9b6-770d88c4b953 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:39.884798 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fdd1c-e2c3-4dbf-990c-1121f99f3444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:39.885401 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fdd1c-e2c3-4dbf-990c-1121f99f3444 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:39.885681 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fdd1c-e2c3-4dbf-990c-1121f99f3444 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:39.885962 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fdd1c-e2c3-4dbf-990c-1121f99f3444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:39.896101 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fdd1c-e2c3-4dbf-990c-1121f99f3444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:39.897537 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fdd1c-e2c3-4dbf-990c-1121f99f3444 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:39.908197 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 575/1147] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:42.165190 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b82933-9cb1-4ed9-b160-33c3d122fda6 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:42.165762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b82933-9cb1-4ed9-b160-33c3d122fda6 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:42.165762 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b82933-9cb1-4ed9-b160-33c3d122fda6 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:42.167122 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 573/1148] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:42.172852 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0f8bd-9d50-44f1-b051-bafb5539781a None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:42.173393 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0f8bd-9d50-44f1-b051-bafb5539781a None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:42.173393 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0f8bd-9d50-44f1-b051-bafb5539781a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:42.202751 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-93d0f8bd-9d50-44f1-b051-bafb5539781a None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:42.204005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-93d0f8bd-9d50-44f1-b051-bafb5539781a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:42.212117 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 576/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:11:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:42.556280 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b82933-9cb1-4ed9-b160-33c3d122fda6 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:42.568441 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b82933-9cb1-4ed9-b160-33c3d122fda6 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:42.572341 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc05384-17c1-4ab2-a8f5-85babf036570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:42.572909 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc05384-17c1-4ab2-a8f5-85babf036570 service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:42.573331 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc05384-17c1-4ab2-a8f5-85babf036570 service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:42.573529 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc05384-17c1-4ab2-a8f5-85babf036570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:42.583418 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc05384-17c1-4ab2-a8f5-85babf036570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:42.584865 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc05384-17c1-4ab2-a8f5-85babf036570 service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:42.596219 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 574/1150] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:46.765483 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78f374-70e9-4177-b84a-86dc5a4e4fb4 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:46.766091 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78f374-70e9-4177-b84a-86dc5a4e4fb4 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:46.766091 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78f374-70e9-4177-b84a-86dc5a4e4fb4 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:46.767469 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 577/1151] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:46.774649 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f77ac-9257-470e-a959-cff96d64f4cc None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:46.775179 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f77ac-9257-470e-a959-cff96d64f4cc None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:46.775388 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f77ac-9257-470e-a959-cff96d64f4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:46.795367 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-3c7f77ac-9257-470e-a959-cff96d64f4cc None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:46.796631 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-3c7f77ac-9257-470e-a959-cff96d64f4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:46.804916 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 575/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:11:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:47.386768 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78f374-70e9-4177-b84a-86dc5a4e4fb4 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:47.388960 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-db78f374-70e9-4177-b84a-86dc5a4e4fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:47.470384 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78f374-70e9-4177-b84a-86dc5a4e4fb4 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:47.474086 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325fe64-ef3e-4c44-a3ec-ff23ba539347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3510dd48a215455fb55bfbec820c7f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:47.474700 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325fe64-ef3e-4c44-a3ec-ff23ba539347 service cinder] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:47.474981 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325fe64-ef3e-4c44-a3ec-ff23ba539347 service cinder] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:47.475277 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325fe64-ef3e-4c44-a3ec-ff23ba539347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:47.485410 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325fe64-ef3e-4c44-a3ec-ff23ba539347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:47.486863 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325fe64-ef3e-4c44-a3ec-ff23ba539347 service cinder] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:47.496927 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 578/1153] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:49.782895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec1a9-cca8-4b05-8ac2-bfb4987f2e2a None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:49.783493 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec1a9-cca8-4b05-8ac2-bfb4987f2e2a None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:49.783493 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec1a9-cca8-4b05-8ac2-bfb4987f2e2a None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:49.784836 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 576/1154] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:49.790897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be7488-894d-4267-8afe-cd37280b4a95 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:49.791688 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be7488-894d-4267-8afe-cd37280b4a95 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:49.791688 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be7488-894d-4267-8afe-cd37280b4a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:49.811893 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-a7be7488-894d-4267-8afe-cd37280b4a95 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:49.813464 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-a7be7488-894d-4267-8afe-cd37280b4a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:49.821726 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 579/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:11:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:50.398531 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaec1a9-cca8-4b05-8ac2-bfb4987f2e2a None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:50.400294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-3aaec1a9-cca8-4b05-8ac2-bfb4987f2e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:50.414955 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaec1a9-cca8-4b05-8ac2-bfb4987f2e2a None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:50.418507 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb309b3-82f0-42a8-aa8c-d81f4e0c7471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3510dd48a215455fb55bfbec820c7f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:50.419121 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb309b3-82f0-42a8-aa8c-d81f4e0c7471 service cinder] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:50.419438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb309b3-82f0-42a8-aa8c-d81f4e0c7471 service cinder] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:50.419773 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb309b3-82f0-42a8-aa8c-d81f4e0c7471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:50.430409 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb309b3-82f0-42a8-aa8c-d81f4e0c7471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:50.431914 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb309b3-82f0-42a8-aa8c-d81f4e0c7471 service cinder] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:50.442920 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 577/1156] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:59.806457 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=75 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:00.438332 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=33 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:10.094442 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4125fe-fcfc-465a-bba7-9b5642cc1cd4 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.095089 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4125fe-fcfc-465a-bba7-9b5642cc1cd4 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.095089 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4125fe-fcfc-465a-bba7-9b5642cc1cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.100959 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9ed09-9b21-4f89-b979-dda62052157b None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.101430 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9ed09-9b21-4f89-b979-dda62052157b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.101540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9ed09-9b21-4f89-b979-dda62052157b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.114954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-9d4125fe-fcfc-465a-bba7-9b5642cc1cd4 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:10.116216 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-9d4125fe-fcfc-465a-bba7-9b5642cc1cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:10.123732 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-53b9ed09-9b21-4f89-b979-dda62052157b None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:10.124133 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 580/1157] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:13:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:10.125077 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-53b9ed09-9b21-4f89-b979-dda62052157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:10.132241 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b89aa-676b-43c6-af4a-2ebfd5fda356 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.132530 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b89aa-676b-43c6-af4a-2ebfd5fda356 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.132806 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b89aa-676b-43c6-af4a-2ebfd5fda356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.133342 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 578/1158] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:13:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:10.141643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4624cfe-1ec9-4531-a00d-cc28871bf5dd None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.142018 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4624cfe-1ec9-4531-a00d-cc28871bf5dd None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.142421 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4624cfe-1ec9-4531-a00d-cc28871bf5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.154287 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-b67b89aa-676b-43c6-af4a-2ebfd5fda356 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:10.155520 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-b67b89aa-676b-43c6-af4a-2ebfd5fda356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:10.162438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-b4624cfe-1ec9-4531-a00d-cc28871bf5dd None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:10.163663 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-b4624cfe-1ec9-4531-a00d-cc28871bf5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:10.163815 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 581/1159] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:13:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:10.168428 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b89aa-676b-43c6-af4a-2ebfd5fda356 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.172973 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 579/1160] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:13:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:10.177546 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4624cfe-1ec9-4531-a00d-cc28871bf5dd None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.178616 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b89aa-676b-43c6-af4a-2ebfd5fda356 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.184001 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f6df6-8e47-442c-94b6-03007078c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.184669 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f6df6-8e47-442c-94b6-03007078c2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.184950 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f6df6-8e47-442c-94b6-03007078c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.185219 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f6df6-8e47-442c-94b6-03007078c2d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.185861 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f6df6-8e47-442c-94b6-03007078c2d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:13:10.186161 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f6df6-8e47-442c-94b6-03007078c2d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.187029 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4624cfe-1ec9-4531-a00d-cc28871bf5dd None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.187797 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f6df6-8e47-442c-94b6-03007078c2d2 admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.191797 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6d61e-c370-4a4b-bd45-9ed919dd6011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.192394 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6d61e-c370-4a4b-bd45-9ed919dd6011 admin admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.192676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6d61e-c370-4a4b-bd45-9ed919dd6011 admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.192950 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6d61e-c370-4a4b-bd45-9ed919dd6011 admin admin] PATH_INFO: `/v3/domains` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.193589 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6d61e-c370-4a4b-bd45-9ed919dd6011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:13:10.193891 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6d61e-c370-4a4b-bd45-9ed919dd6011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.194888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: WARNING py.warnings [None req-1db6d61e-c370-4a4b-bd45-9ed919dd6011 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:13:10.194888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: warnings.warn(msg) Aug 18 21:13:10.194888 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: Aug 18 21:13:10.195786 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6d61e-c370-4a4b-bd45-9ed919dd6011 admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.199745 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 582/1161] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Aug 18 21:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:13:10.207658 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f6df6-8e47-442c-94b6-03007078c2d2 admin admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.212434 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 580/1162] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Aug 18 21:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:13:10.218134 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f6df6-8e47-442c-94b6-03007078c2d2 admin admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.220748 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6d61e-c370-4a4b-bd45-9ed919dd6011 admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.222932 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c0148-6746-4ac9-a868-8df86451e97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.223567 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c0148-6746-4ac9-a868-8df86451e97a admin admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.223853 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c0148-6746-4ac9-a868-8df86451e97a admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.224127 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c0148-6746-4ac9-a868-8df86451e97a admin admin] PATH_INFO: `/v3/projects` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.224745 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c0148-6746-4ac9-a868-8df86451e97a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.225759 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: WARNING py.warnings [None req-570c0148-6746-4ac9-a868-8df86451e97a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:13:10.225759 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: warnings.warn(msg) Aug 18 21:13:10.225759 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: Aug 18 21:13:10.227015 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c0148-6746-4ac9-a868-8df86451e97a admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.230278 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6d61e-c370-4a4b-bd45-9ed919dd6011 admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.235548 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca42900-3001-47e7-a3af-3d61661dee59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.236662 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca42900-3001-47e7-a3af-3d61661dee59 admin admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.236964 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca42900-3001-47e7-a3af-3d61661dee59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.237271 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca42900-3001-47e7-a3af-3d61661dee59 admin admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.237977 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca42900-3001-47e7-a3af-3d61661dee59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.239982 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca42900-3001-47e7-a3af-3d61661dee59 admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.266794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 583/1163] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:10 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:10.273190 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 581/1164] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:10 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:10.274080 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c0148-6746-4ac9-a868-8df86451e97a admin admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.274376 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca42900-3001-47e7-a3af-3d61661dee59 admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.348303 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca42900-3001-47e7-a3af-3d61661dee59 admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.349611 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c0148-6746-4ac9-a868-8df86451e97a admin admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.353157 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d992fe5-9338-440b-b477-6c5bd49d196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.353770 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d992fe5-9338-440b-b477-6c5bd49d196c admin admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.354046 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d992fe5-9338-440b-b477-6c5bd49d196c admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.354317 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d992fe5-9338-440b-b477-6c5bd49d196c admin admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.354425 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a632c-03f4-4692-8808-708bb45d1d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.354932 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a632c-03f4-4692-8808-708bb45d1d23 admin admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.355027 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d992fe5-9338-440b-b477-6c5bd49d196c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.355214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a632c-03f4-4692-8808-708bb45d1d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.355521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a632c-03f4-4692-8808-708bb45d1d23 admin admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.356023 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: WARNING py.warnings [None req-7d992fe5-9338-440b-b477-6c5bd49d196c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:13:10.356023 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: warnings.warn(msg) Aug 18 21:13:10.356023 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: Aug 18 21:13:10.356273 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a632c-03f4-4692-8808-708bb45d1d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.357539 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d992fe5-9338-440b-b477-6c5bd49d196c admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.358505 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a632c-03f4-4692-8808-708bb45d1d23 admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.380164 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 582/1165] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:10 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:10.385140 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d992fe5-9338-440b-b477-6c5bd49d196c admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.387166 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 584/1166] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:10 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:10.388786 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a632c-03f4-4692-8808-708bb45d1d23 admin admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.396646 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d992fe5-9338-440b-b477-6c5bd49d196c admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.399531 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a632c-03f4-4692-8808-708bb45d1d23 admin admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.401467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352b61a-6e57-45db-b4be-f05af1e49a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.402078 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352b61a-6e57-45db-b4be-f05af1e49a9a admin admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.402345 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352b61a-6e57-45db-b4be-f05af1e49a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.402613 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352b61a-6e57-45db-b4be-f05af1e49a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.403302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352b61a-6e57-45db-b4be-f05af1e49a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.404862 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02695a5b-6f14-4298-8a9b-4d7703c136e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.405461 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02695a5b-6f14-4298-8a9b-4d7703c136e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.405569 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352b61a-6e57-45db-b4be-f05af1e49a9a admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.405744 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02695a5b-6f14-4298-8a9b-4d7703c136e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.406019 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02695a5b-6f14-4298-8a9b-4d7703c136e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.406665 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02695a5b-6f14-4298-8a9b-4d7703c136e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.408299 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02695a5b-6f14-4298-8a9b-4d7703c136e6 admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.418275 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 583/1167] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:13:10.418498 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 585/1168] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:13:10.422278 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352b61a-6e57-45db-b4be-f05af1e49a9a admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.422478 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02695a5b-6f14-4298-8a9b-4d7703c136e6 admin admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.432833 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352b61a-6e57-45db-b4be-f05af1e49a9a admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.433080 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02695a5b-6f14-4298-8a9b-4d7703c136e6 admin admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.437738 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb24ab-b926-4b72-b5a3-9a9d59d4a80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.437916 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ef91b-7559-48bb-8830-77ad8805dc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.438531 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ef91b-7559-48bb-8830-77ad8805dc3c admin admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.438665 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb24ab-b926-4b72-b5a3-9a9d59d4a80c admin admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.438829 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb24ab-b926-4b72-b5a3-9a9d59d4a80c admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.438939 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ef91b-7559-48bb-8830-77ad8805dc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.439079 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ef91b-7559-48bb-8830-77ad8805dc3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.439185 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb24ab-b926-4b72-b5a3-9a9d59d4a80c admin admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.439769 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ef91b-7559-48bb-8830-77ad8805dc3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.439905 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb24ab-b926-4b72-b5a3-9a9d59d4a80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.441385 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ef91b-7559-48bb-8830-77ad8805dc3c admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.441648 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb24ab-b926-4b72-b5a3-9a9d59d4a80c admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.453654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 584/1170] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:13:10.453888 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 586/1170] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:13:10.457799 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ef91b-7559-48bb-8830-77ad8805dc3c admin admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.457991 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb24ab-b926-4b72-b5a3-9a9d59d4a80c admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.469920 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb24ab-b926-4b72-b5a3-9a9d59d4a80c admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.471354 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ef91b-7559-48bb-8830-77ad8805dc3c admin admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.478857 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3f95f-66cb-4cba-9d6b-f28d813bfd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.479471 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118c251-a600-46fc-adc7-addeb0ffccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.479638 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3f95f-66cb-4cba-9d6b-f28d813bfd73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.479908 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3f95f-66cb-4cba-9d6b-f28d813bfd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.480184 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3f95f-66cb-4cba-9d6b-f28d813bfd73 admin admin] PATH_INFO: `/v3/projects/a72ada771de84464beebe8bbb23bf990/users/f6549a70b69645a6a8bd333c11c10c99/roles/70cebcd047db4003b7016de5c93cab80` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.480460 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118c251-a600-46fc-adc7-addeb0ffccf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.480739 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118c251-a600-46fc-adc7-addeb0ffccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.481010 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118c251-a600-46fc-adc7-addeb0ffccf0 admin admin] PATH_INFO: `/v3/projects/8eb23580723f4481be6477d5dd085fa2/users/928951d9fc9444ca8d5ac6b38c4240cc/roles/70cebcd047db4003b7016de5c93cab80` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.496877 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3f95f-66cb-4cba-9d6b-f28d813bfd73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72ada771de84464beebe8bbb23bf990, user_id=f6549a70b69645a6a8bd333c11c10c99, role_id=70cebcd047db4003b7016de5c93cab80)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.499672 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3f95f-66cb-4cba-9d6b-f28d813bfd73 admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.503804 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118c251-a600-46fc-adc7-addeb0ffccf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb23580723f4481be6477d5dd085fa2, user_id=928951d9fc9444ca8d5ac6b38c4240cc, role_id=70cebcd047db4003b7016de5c93cab80)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.505035 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: WARNING py.warnings [None req-e118c251-a600-46fc-adc7-addeb0ffccf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:13:10.505035 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: warnings.warn(msg) Aug 18 21:13:10.505035 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: Aug 18 21:13:10.507496 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118c251-a600-46fc-adc7-addeb0ffccf0 admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.515758 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 585/1171] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:10 2022] PUT /identity/v3/projects/a72ada771de84464beebe8bbb23bf990/users/f6549a70b69645a6a8bd333c11c10c99/roles/70cebcd047db4003b7016de5c93cab80 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:10.521843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de991c6-2fea-4536-822c-458afd57b3ef None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.522296 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de991c6-2fea-4536-822c-458afd57b3ef None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.522732 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de991c6-2fea-4536-822c-458afd57b3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.524158 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 587/1172] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:10 2022] PUT /identity/v3/projects/8eb23580723f4481be6477d5dd085fa2/users/928951d9fc9444ca8d5ac6b38c4240cc/roles/70cebcd047db4003b7016de5c93cab80 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:10.532073 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f656f57-66c2-42b2-bea0-5152c66e3436 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.532361 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f656f57-66c2-42b2-bea0-5152c66e3436 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.532636 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f656f57-66c2-42b2-bea0-5152c66e3436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.546540 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-9de991c6-2fea-4536-822c-458afd57b3ef None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:10.547796 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-9de991c6-2fea-4536-822c-458afd57b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:10.551543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-2f656f57-66c2-42b2-bea0-5152c66e3436 None None] MFA Rules not processed for user `71471eb8a3e6483ebb3f0a3b9d99aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:10.552727 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-2f656f57-66c2-42b2-bea0-5152c66e3436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:10.597883 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:10.612021 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:10.620953 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 588/1173] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:13:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:10.627839 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 586/1174] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:13:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:10.631860 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f656f57-66c2-42b2-bea0-5152c66e3436 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.641585 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de991c6-2fea-4536-822c-458afd57b3ef None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.643623 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-9de991c6-2fea-4536-822c-458afd57b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:10.696611 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f656f57-66c2-42b2-bea0-5152c66e3436 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.700868 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc437058-4274-4b63-bc07-91a25a84b91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.701487 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc437058-4274-4b63-bc07-91a25a84b91b service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.701770 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc437058-4274-4b63-bc07-91a25a84b91b service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.702039 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc437058-4274-4b63-bc07-91a25a84b91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.714026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc437058-4274-4b63-bc07-91a25a84b91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.717208 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc437058-4274-4b63-bc07-91a25a84b91b service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.728685 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 589/1175] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:10.733708 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de991c6-2fea-4536-822c-458afd57b3ef None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.737513 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf95ae-771f-4a22-ad37-2a7917471a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.738128 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf95ae-771f-4a22-ad37-2a7917471a27 service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.738404 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf95ae-771f-4a22-ad37-2a7917471a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.738681 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf95ae-771f-4a22-ad37-2a7917471a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.748921 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf95ae-771f-4a22-ad37-2a7917471a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.750382 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf95ae-771f-4a22-ad37-2a7917471a27 service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.760704 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 587/1176] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:13:16.318426 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6af75-7b41-45f1-9d8a-03a4724e8ab1 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:16.318975 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6af75-7b41-45f1-9d8a-03a4724e8ab1 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:16.318975 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6af75-7b41-45f1-9d8a-03a4724e8ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:16.359970 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-30f6af75-7b41-45f1-9d8a-03a4724e8ab1 None None] MFA Rules not processed for user `928951d9fc9444ca8d5ac6b38c4240cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:16.361371 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-30f6af75-7b41-45f1-9d8a-03a4724e8ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:16.476521 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 590/1177] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:13:16 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:16.477375 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf95ae-771f-4a22-ad37-2a7917471a27 service neutron] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:16.493621 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf95ae-771f-4a22-ad37-2a7917471a27 service neutron] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:16.497481 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b20a6-32a3-477d-a3d3-223a5a0dca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:16.498169 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b20a6-32a3-477d-a3d3-223a5a0dca0d admin admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:16.498389 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b20a6-32a3-477d-a3d3-223a5a0dca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:16.498663 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b20a6-32a3-477d-a3d3-223a5a0dca0d admin admin] PATH_INFO: `/v3/projects` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:16.499467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b20a6-32a3-477d-a3d3-223a5a0dca0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:16.508851 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b20a6-32a3-477d-a3d3-223a5a0dca0d admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:16.603986 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 588/1178] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:16 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:16.606504 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6af75-7b41-45f1-9d8a-03a4724e8ab1 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:16.628639 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6af75-7b41-45f1-9d8a-03a4724e8ab1 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:16.753839 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c30c1a-65ae-4eea-8efc-5e5657e1a96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:16.754478 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c30c1a-65ae-4eea-8efc-5e5657e1a96a admin admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:16.754758 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c30c1a-65ae-4eea-8efc-5e5657e1a96a admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:16.755036 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c30c1a-65ae-4eea-8efc-5e5657e1a96a admin admin] PATH_INFO: `/v3/users` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:16.755711 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c30c1a-65ae-4eea-8efc-5e5657e1a96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:16.757685 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c30c1a-65ae-4eea-8efc-5e5657e1a96a admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:16.796263 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 591/1179] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:16 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:16.797791 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b20a6-32a3-477d-a3d3-223a5a0dca0d admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:16.815951 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b20a6-32a3-477d-a3d3-223a5a0dca0d admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:16.833290 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c913-d03a-43fa-b766-75b92fc6145b None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:16.833622 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c913-d03a-43fa-b766-75b92fc6145b None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:16.833911 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c913-d03a-43fa-b766-75b92fc6145b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:16.834362 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e1e79-9739-40a1-8cdd-7af921fd3e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:16.835286 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e1e79-9739-40a1-8cdd-7af921fd3e1d admin admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:16.835896 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e1e79-9739-40a1-8cdd-7af921fd3e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:16.836270 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e1e79-9739-40a1-8cdd-7af921fd3e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:16.837076 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e1e79-9739-40a1-8cdd-7af921fd3e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:16.839843 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e1e79-9739-40a1-8cdd-7af921fd3e1d admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:16.862184 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 589/1180] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:16.862995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:16.864465 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e1e79-9739-40a1-8cdd-7af921fd3e1d admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:16.878327 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-c958c913-d03a-43fa-b766-75b92fc6145b None None] MFA Rules not processed for user `f6549a70b69645a6a8bd333c11c10c99`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:16.878832 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e1e79-9739-40a1-8cdd-7af921fd3e1d admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:16.879612 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-c958c913-d03a-43fa-b766-75b92fc6145b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:16.889036 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1e9c4-eef7-4f9b-943f-6816c0f26d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:16.889785 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1e9c4-eef7-4f9b-943f-6816c0f26d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:16.892225 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1e9c4-eef7-4f9b-943f-6816c0f26d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:16.892815 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1e9c4-eef7-4f9b-943f-6816c0f26d8c admin admin] PATH_INFO: `/v3/projects/96c6fafd1a1d42a7a06b5fad0bcaf8b2/users/eb73431c513b4405aa65075d2536247b/roles/49c7d15532d94cafac420a6bcf8574ad` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:16.927235 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1e9c4-eef7-4f9b-943f-6816c0f26d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c6fafd1a1d42a7a06b5fad0bcaf8b2, user_id=eb73431c513b4405aa65075d2536247b, role_id=49c7d15532d94cafac420a6bcf8574ad)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:16.929808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1e9c4-eef7-4f9b-943f-6816c0f26d8c admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:16.960614 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 590/1181] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:16 2022] PUT /identity/v3/projects/96c6fafd1a1d42a7a06b5fad0bcaf8b2/users/eb73431c513b4405aa65075d2536247b/roles/49c7d15532d94cafac420a6bcf8574ad => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:16.961575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1e9c4-eef7-4f9b-943f-6816c0f26d8c admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:16.983106 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 592/1182] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:13:16 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:16.988131 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c913-d03a-43fa-b766-75b92fc6145b None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:17.004963 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c913-d03a-43fa-b766-75b92fc6145b None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:17.057838 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1e9c4-eef7-4f9b-943f-6816c0f26d8c admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:17.065641 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44853ab2-5377-444d-bf57-1e2850e8ba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:17.066387 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853ab2-5377-444d-bf57-1e2850e8ba77 admin admin] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:17.066582 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853ab2-5377-444d-bf57-1e2850e8ba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:17.066913 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853ab2-5377-444d-bf57-1e2850e8ba77 admin admin] PATH_INFO: `/v3/roles` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:17.067526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44853ab2-5377-444d-bf57-1e2850e8ba77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:17.069881 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44853ab2-5377-444d-bf57-1e2850e8ba77 admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:17.090137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 591/1183] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:17.091589 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44853ab2-5377-444d-bf57-1e2850e8ba77 admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:17.097848 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a4a1a-86df-46c6-b9a0-2a9a2e3c5856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:17.098486 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a4a1a-86df-46c6-b9a0-2a9a2e3c5856 admin admin] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:17.099575 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a4a1a-86df-46c6-b9a0-2a9a2e3c5856 admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:17.099909 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a4a1a-86df-46c6-b9a0-2a9a2e3c5856 admin admin] PATH_INFO: `/v3/projects` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:17.100511 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a4a1a-86df-46c6-b9a0-2a9a2e3c5856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:17.103157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a4a1a-86df-46c6-b9a0-2a9a2e3c5856 admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:17.106083 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44853ab2-5377-444d-bf57-1e2850e8ba77 admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:17.114655 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662357ab-f30f-42ee-8d09-8f8a90e3df2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:17.115660 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662357ab-f30f-42ee-8d09-8f8a90e3df2b admin admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:17.115794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662357ab-f30f-42ee-8d09-8f8a90e3df2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:17.116028 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662357ab-f30f-42ee-8d09-8f8a90e3df2b admin admin] PATH_INFO: `/v3/projects/96c6fafd1a1d42a7a06b5fad0bcaf8b2/users/eb73431c513b4405aa65075d2536247b/roles/49c7d15532d94cafac420a6bcf8574ad` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:17.118134 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662357ab-f30f-42ee-8d09-8f8a90e3df2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c6fafd1a1d42a7a06b5fad0bcaf8b2, user_id=eb73431c513b4405aa65075d2536247b, role_id=49c7d15532d94cafac420a6bcf8574ad)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:17.121123 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662357ab-f30f-42ee-8d09-8f8a90e3df2b admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:17.145847 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 592/1184] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:17 2022] PUT /identity/v3/projects/96c6fafd1a1d42a7a06b5fad0bcaf8b2/users/eb73431c513b4405aa65075d2536247b/roles/49c7d15532d94cafac420a6bcf8574ad => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:17.179593 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 593/1185] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:16 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:17.180602 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662357ab-f30f-42ee-8d09-8f8a90e3df2b admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:17.214696 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:17.367008 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662357ab-f30f-42ee-8d09-8f8a90e3df2b admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:17.470172 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90f727-e4de-4a53-9c59-a0c2b651b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:17.471292 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90f727-e4de-4a53-9c59-a0c2b651b14f admin admin] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:17.471867 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90f727-e4de-4a53-9c59-a0c2b651b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:17.472412 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90f727-e4de-4a53-9c59-a0c2b651b14f admin admin] PATH_INFO: `/v3/users` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:17.473492 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90f727-e4de-4a53-9c59-a0c2b651b14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:17.476797 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90f727-e4de-4a53-9c59-a0c2b651b14f admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:17.519374 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 593/1186] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:17 2022] POST /identity/v3/users => generated 295 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:17.524776 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a4a1a-86df-46c6-b9a0-2a9a2e3c5856 admin admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:17.538735 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a4a1a-86df-46c6-b9a0-2a9a2e3c5856 admin admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:17.547368 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e88cc-d1b7-470c-8a49-a12f22917c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:17.547997 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e88cc-d1b7-470c-8a49-a12f22917c22 admin admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:17.548282 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e88cc-d1b7-470c-8a49-a12f22917c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:17.548942 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e88cc-d1b7-470c-8a49-a12f22917c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:17.549189 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e88cc-d1b7-470c-8a49-a12f22917c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:17.550803 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e88cc-d1b7-470c-8a49-a12f22917c22 admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:17.568202 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90f727-e4de-4a53-9c59-a0c2b651b14f admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:17.574059 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 594/1187] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:17.586115 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90f727-e4de-4a53-9c59-a0c2b651b14f admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:17.592759 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a28219-4997-487b-8fed-f18881803795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:17.593493 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a28219-4997-487b-8fed-f18881803795 admin admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:17.593874 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a28219-4997-487b-8fed-f18881803795 admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:17.594355 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a28219-4997-487b-8fed-f18881803795 admin admin] PATH_INFO: `/v3/projects/4509f429ec824f6a987f4efc5c9b8506/users/4a200626f46c40e6b23cab45af448b88/roles/49c7d15532d94cafac420a6bcf8574ad` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:17.634078 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a28219-4997-487b-8fed-f18881803795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4509f429ec824f6a987f4efc5c9b8506, user_id=4a200626f46c40e6b23cab45af448b88, role_id=49c7d15532d94cafac420a6bcf8574ad)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:17.640228 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a28219-4997-487b-8fed-f18881803795 admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:17.669299 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 594/1188] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:17 2022] PUT /identity/v3/projects/4509f429ec824f6a987f4efc5c9b8506/users/4a200626f46c40e6b23cab45af448b88/roles/49c7d15532d94cafac420a6bcf8574ad => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:17.673262 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e88cc-d1b7-470c-8a49-a12f22917c22 admin admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:17.697713 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e88cc-d1b7-470c-8a49-a12f22917c22 admin admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:17.842144 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2488c3-78e3-425a-9a91-da4b11c9056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:17.843122 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2488c3-78e3-425a-9a91-da4b11c9056a admin admin] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:17.843617 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2488c3-78e3-425a-9a91-da4b11c9056a admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:17.844096 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2488c3-78e3-425a-9a91-da4b11c9056a admin admin] PATH_INFO: `/v3/roles` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:17.844933 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2488c3-78e3-425a-9a91-da4b11c9056a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:17.846745 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2488c3-78e3-425a-9a91-da4b11c9056a admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:17.869191 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 595/1189] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:17.878135 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a28219-4997-487b-8fed-f18881803795 admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:17.894544 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a28219-4997-487b-8fed-f18881803795 admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:17.905684 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db208e85-cf36-40cb-a55f-734e9d4da26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:17.906884 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db208e85-cf36-40cb-a55f-734e9d4da26f admin admin] REQUEST_METHOD: `PUT` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:17.907507 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db208e85-cf36-40cb-a55f-734e9d4da26f admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:17.907968 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db208e85-cf36-40cb-a55f-734e9d4da26f admin admin] PATH_INFO: `/v3/projects/4509f429ec824f6a987f4efc5c9b8506/users/4a200626f46c40e6b23cab45af448b88/roles/49c7d15532d94cafac420a6bcf8574ad` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:17.912666 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db208e85-cf36-40cb-a55f-734e9d4da26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4509f429ec824f6a987f4efc5c9b8506, user_id=4a200626f46c40e6b23cab45af448b88, role_id=49c7d15532d94cafac420a6bcf8574ad)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:17.919002 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db208e85-cf36-40cb-a55f-734e9d4da26f admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:17.961269 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 595/1190] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:17 2022] PUT /identity/v3/projects/4509f429ec824f6a987f4efc5c9b8506/users/4a200626f46c40e6b23cab45af448b88/roles/49c7d15532d94cafac420a6bcf8574ad => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:23.952373 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb1914-4341-41aa-b8a4-4ebde3d27318 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:23.952947 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb1914-4341-41aa-b8a4-4ebde3d27318 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:23.952947 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb1914-4341-41aa-b8a4-4ebde3d27318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:23.998440 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:24.022418 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-63bb1914-4341-41aa-b8a4-4ebde3d27318 None None] MFA Rules not processed for user `eb73431c513b4405aa65075d2536247b`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:24.025771 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-63bb1914-4341-41aa-b8a4-4ebde3d27318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:24.204642 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 596/1191] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:13:23 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:24.221856 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db208e85-cf36-40cb-a55f-734e9d4da26f admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:24.226577 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-db208e85-cf36-40cb-a55f-734e9d4da26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:24.349926 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db208e85-cf36-40cb-a55f-734e9d4da26f admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:24.356281 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d456179-71a4-45e2-b1b0-b3e92523d7f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255b174cea9f41f6970978c44bec2b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:24.357093 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d456179-71a4-45e2-b1b0-b3e92523d7f1 service glance] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:24.357375 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d456179-71a4-45e2-b1b0-b3e92523d7f1 service glance] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:24.357654 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d456179-71a4-45e2-b1b0-b3e92523d7f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:24.376253 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:24.472040 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d456179-71a4-45e2-b1b0-b3e92523d7f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:24.474341 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d456179-71a4-45e2-b1b0-b3e92523d7f1 service glance] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:24.487656 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 596/1192] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:24 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:24.754390 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764f848-5ebf-407b-9c86-7d27c1707faf None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:24.754706 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764f848-5ebf-407b-9c86-7d27c1707faf None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:24.754993 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764f848-5ebf-407b-9c86-7d27c1707faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:24.813453 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-8764f848-5ebf-407b-9c86-7d27c1707faf None None] MFA Rules not processed for user `4a200626f46c40e6b23cab45af448b88`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:24.816954 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-8764f848-5ebf-407b-9c86-7d27c1707faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:24.986458 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 597/1193] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:13:24 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:24.997970 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d456179-71a4-45e2-b1b0-b3e92523d7f1 service glance] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:25.014454 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d456179-71a4-45e2-b1b0-b3e92523d7f1 service glance] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:25.019416 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffbb11-036b-4579-8e85-8daf90ef93b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255b174cea9f41f6970978c44bec2b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:25.020557 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffbb11-036b-4579-8e85-8daf90ef93b7 service glance] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:25.021119 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffbb11-036b-4579-8e85-8daf90ef93b7 service glance] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:25.021633 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffbb11-036b-4579-8e85-8daf90ef93b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:25.156040 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffbb11-036b-4579-8e85-8daf90ef93b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:25.162348 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffbb11-036b-4579-8e85-8daf90ef93b7 service glance] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:25.182820 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 597/1194] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:24 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:34.060122 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f10b34-5a2d-41b8-a1cb-9217e47f3a6c None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.060704 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f10b34-5a2d-41b8-a1cb-9217e47f3a6c None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.060704 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f10b34-5a2d-41b8-a1cb-9217e47f3a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.084365 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-c2f10b34-5a2d-41b8-a1cb-9217e47f3a6c None None] MFA Rules not processed for user `928951d9fc9444ca8d5ac6b38c4240cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:34.085574 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-c2f10b34-5a2d-41b8-a1cb-9217e47f3a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:34.096268 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 598/1195] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:13:34 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:34.461409 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83699636-f1f0-4f52-8fc3-db9f6c9f7ade None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.462124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83699636-f1f0-4f52-8fc3-db9f6c9f7ade None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.462662 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83699636-f1f0-4f52-8fc3-db9f6c9f7ade None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.466657 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 598/1196] 10.222.0.16 () {54 vars in 962 bytes} [Thu Aug 18 21:13:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:34.474447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878bd8-c0be-4fdf-b93c-afb5178d2a0d None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.474951 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878bd8-c0be-4fdf-b93c-afb5178d2a0d None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.475239 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878bd8-c0be-4fdf-b93c-afb5178d2a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.522443 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-d0878bd8-c0be-4fdf-b93c-afb5178d2a0d None None] MFA Rules not processed for user `ba197525d2af40528f7cbe7de9da9a23`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:34.523811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-d0878bd8-c0be-4fdf-b93c-afb5178d2a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:34.629343 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=100 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:34.643503 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 599/1197] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Aug 18 21:13:34 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:34.649260 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b3b2d-4f38-4ebd-af15-c3a1400bd025 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.649549 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b3b2d-4f38-4ebd-af15-c3a1400bd025 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.649824 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b3b2d-4f38-4ebd-af15-c3a1400bd025 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.651304 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 599/1198] 10.222.0.16 () {54 vars in 912 bytes} [Thu Aug 18 21:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:34.662494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867280a-7336-4ef8-ab83-0163143c2805 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.662785 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867280a-7336-4ef8-ab83-0163143c2805 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.663061 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867280a-7336-4ef8-ab83-0163143c2805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.692692 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-4867280a-7336-4ef8-ab83-0163143c2805 None None] MFA Rules not processed for user `ba197525d2af40528f7cbe7de9da9a23`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:34.693885 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-4867280a-7336-4ef8-ab83-0163143c2805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:34.707625 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 600/1199] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Aug 18 21:13:34 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:34.735653 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b3b2d-4f38-4ebd-af15-c3a1400bd025 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:34.739088 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-251b3b2d-4f38-4ebd-af15-c3a1400bd025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:34.759934 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b3b2d-4f38-4ebd-af15-c3a1400bd025 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:34.764652 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dd149-9d2a-4765-85f2-0ca0149540a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255b174cea9f41f6970978c44bec2b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:34.765283 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd149-9d2a-4765-85f2-0ca0149540a0 service glance] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.765561 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd149-9d2a-4765-85f2-0ca0149540a0 service glance] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.765964 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd149-9d2a-4765-85f2-0ca0149540a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.778262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dd149-9d2a-4765-85f2-0ca0149540a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:34.780842 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dd149-9d2a-4765-85f2-0ca0149540a0 service glance] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:34.810003 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 600/1200] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:34 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:35.267026 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb271-8c39-49d2-8a83-73fdcd97ebe3 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:35.267622 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb271-8c39-49d2-8a83-73fdcd97ebe3 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:35.268041 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb271-8c39-49d2-8a83-73fdcd97ebe3 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:35.270809 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 601/1201] 10.222.0.16 () {54 vars in 912 bytes} [Thu Aug 18 21:13:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:35.280808 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212ffe5-cc68-4fd3-874a-7145332420e2 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:35.281103 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212ffe5-cc68-4fd3-874a-7145332420e2 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:35.282544 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212ffe5-cc68-4fd3-874a-7145332420e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:35.307383 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-e212ffe5-cc68-4fd3-874a-7145332420e2 None None] MFA Rules not processed for user `b9326ebc83a2471a856f668ee77285c5`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:35.309249 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-e212ffe5-cc68-4fd3-874a-7145332420e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:35.396637 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 601/1202] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Aug 18 21:13:35 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:35.413210 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb271-8c39-49d2-8a83-73fdcd97ebe3 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:35.437713 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb271-8c39-49d2-8a83-73fdcd97ebe3 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:35.443965 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb614a-2818-4f26-abdd-c15317715859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:35.445327 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb614a-2818-4f26-abdd-c15317715859 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:35.445908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb614a-2818-4f26-abdd-c15317715859 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:35.446934 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb614a-2818-4f26-abdd-c15317715859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:35.459536 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb614a-2818-4f26-abdd-c15317715859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:35.462398 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb614a-2818-4f26-abdd-c15317715859 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:35.481964 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 602/1203] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:35 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:36.004903 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62833-c854-4710-934b-f84bfb80518b None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:36.005288 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62833-c854-4710-934b-f84bfb80518b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:36.005758 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62833-c854-4710-934b-f84bfb80518b None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:36.008579 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 602/1204] 10.222.0.16 () {54 vars in 962 bytes} [Thu Aug 18 21:13:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:13:36.015167 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f2c6a-4b5f-462e-99db-9192feacd704 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:36.015492 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f2c6a-4b5f-462e-99db-9192feacd704 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:36.015774 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f2c6a-4b5f-462e-99db-9192feacd704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:36.033765 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f229e93-63f8-4be3-9491-55c196bd8622 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:36.035467 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f229e93-63f8-4be3-9491-55c196bd8622 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:36.036196 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f229e93-63f8-4be3-9491-55c196bd8622 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:36.039756 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 603/1205] 10.222.0.16 () {54 vars in 961 bytes} [Thu Aug 18 21:13:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:36.043613 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-047f2c6a-4b5f-462e-99db-9192feacd704 None None] MFA Rules not processed for user `ba197525d2af40528f7cbe7de9da9a23`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:36.045544 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-047f2c6a-4b5f-462e-99db-9192feacd704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:36.050643 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c65af0-0fa1-40e9-a177-f8b46cacb191 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:36.051213 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c65af0-0fa1-40e9-a177-f8b46cacb191 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:36.051775 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c65af0-0fa1-40e9-a177-f8b46cacb191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:36.063482 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 603/1206] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Aug 18 21:13:36 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:36.065172 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0293cb1-bec3-4ff5-a47e-7fc3e1e76bcf None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:36.065466 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0293cb1-bec3-4ff5-a47e-7fc3e1e76bcf None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:36.066324 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0293cb1-bec3-4ff5-a47e-7fc3e1e76bcf None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:36.068995 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 604/1207] 10.222.0.16 () {54 vars in 912 bytes} [Thu Aug 18 21:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:36.078035 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5790067-0c41-42af-bc70-975e60925ef6 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:36.079206 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5790067-0c41-42af-bc70-975e60925ef6 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:36.079592 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5790067-0c41-42af-bc70-975e60925ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:36.088637 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-c0c65af0-0fa1-40e9-a177-f8b46cacb191 None None] MFA Rules not processed for user `42119f8b3cd5446ea7aca396ad1a0f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:36.090450 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-c0c65af0-0fa1-40e9-a177-f8b46cacb191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:36.112638 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-d5790067-0c41-42af-bc70-975e60925ef6 None None] MFA Rules not processed for user `ba197525d2af40528f7cbe7de9da9a23`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:36.114059 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-d5790067-0c41-42af-bc70-975e60925ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:36.129455 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 605/1208] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Aug 18 21:13:36 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:36.154564 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5790067-0c41-42af-bc70-975e60925ef6 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:36.164923 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5790067-0c41-42af-bc70-975e60925ef6 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:36.169378 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fe0c4-c5a2-4312-9e84-e3088e493e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:36.170077 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fe0c4-c5a2-4312-9e84-e3088e493e98 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:36.170415 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fe0c4-c5a2-4312-9e84-e3088e493e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:36.170742 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fe0c4-c5a2-4312-9e84-e3088e493e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:36.182051 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fe0c4-c5a2-4312-9e84-e3088e493e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:36.183745 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fe0c4-c5a2-4312-9e84-e3088e493e98 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:36.193034 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=100 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:36.206809 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 606/1209] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:36 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:36.239348 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 604/1210] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Aug 18 21:13:36 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:36.245566 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fe0c4-c5a2-4312-9e84-e3088e493e98 service neutron] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:36.277644 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fe0c4-c5a2-4312-9e84-e3088e493e98 service neutron] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:36.288409 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b39fb-c13b-4fd9-8680-cea27e7d77ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42119f8b3cd5446ea7aca396ad1a0f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:36.290332 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b39fb-c13b-4fd9-8680-cea27e7d77ca service placement] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:36.291457 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b39fb-c13b-4fd9-8680-cea27e7d77ca service placement] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:36.292185 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b39fb-c13b-4fd9-8680-cea27e7d77ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:36.296641 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-1e6b39fb-c13b-4fd9-8680-cea27e7d77ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:36.332550 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b39fb-c13b-4fd9-8680-cea27e7d77ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:36.334531 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b39fb-c13b-4fd9-8680-cea27e7d77ca service placement] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:36.377419 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 607/1211] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:36 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:13:46.218516 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=6 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:46.363929 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=28 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:47.996693 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d20b2a-74c9-4db1-b175-6a6df491be82 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:47.997383 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d20b2a-74c9-4db1-b175-6a6df491be82 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:47.997383 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d20b2a-74c9-4db1-b175-6a6df491be82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:48.019524 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-02d20b2a-74c9-4db1-b175-6a6df491be82 None None] MFA Rules not processed for user `b9326ebc83a2471a856f668ee77285c5`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:48.020778 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-02d20b2a-74c9-4db1-b175-6a6df491be82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:48.028963 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 605/1212] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Aug 18 21:13:47 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:48.041527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b39fb-c13b-4fd9-8680-cea27e7d77ca service placement] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:48.052308 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b39fb-c13b-4fd9-8680-cea27e7d77ca service placement] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:48.056240 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e33a2-015e-439b-b387-31a0ce76f30f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:48.057137 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e33a2-015e-439b-b387-31a0ce76f30f service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:48.057416 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e33a2-015e-439b-b387-31a0ce76f30f service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:48.057693 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e33a2-015e-439b-b387-31a0ce76f30f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:48.065447 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e33a2-015e-439b-b387-31a0ce76f30f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:48.066870 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e33a2-015e-439b-b387-31a0ce76f30f service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:48.075709 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 608/1213] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:48 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:48.832425 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84dc4-8a01-4860-925f-6e3626ec9698 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:48.833038 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84dc4-8a01-4860-925f-6e3626ec9698 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:48.833504 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84dc4-8a01-4860-925f-6e3626ec9698 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:48.835167 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 606/1214] 10.222.0.16 () {54 vars in 921 bytes} [Thu Aug 18 21:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:48.870124 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953ad5e-cee4-476d-9ec8-067728219a2a None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:48.871592 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953ad5e-cee4-476d-9ec8-067728219a2a None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:48.871886 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953ad5e-cee4-476d-9ec8-067728219a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:48.904387 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-9953ad5e-cee4-476d-9ec8-067728219a2a None None] MFA Rules not processed for user `ba197525d2af40528f7cbe7de9da9a23`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:48.908132 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-9953ad5e-cee4-476d-9ec8-067728219a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:48.919388 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 609/1215] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Aug 18 21:13:48 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:48.943350 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e84dc4-8a01-4860-925f-6e3626ec9698 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:48.959101 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e84dc4-8a01-4860-925f-6e3626ec9698 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:48.965971 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05923a7-c4ce-48da-86ef-7833281bb0af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:48.966671 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05923a7-c4ce-48da-86ef-7833281bb0af service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:48.966952 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05923a7-c4ce-48da-86ef-7833281bb0af service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:48.967222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05923a7-c4ce-48da-86ef-7833281bb0af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:48.984506 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05923a7-c4ce-48da-86ef-7833281bb0af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:48.986280 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05923a7-c4ce-48da-86ef-7833281bb0af service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:49.007884 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 607/1216] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:48 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:56.220612 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79355150-b9e6-43c2-af71-3f4e50768ee4 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.221643 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79355150-b9e6-43c2-af71-3f4e50768ee4 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.222098 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79355150-b9e6-43c2-af71-3f4e50768ee4 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.224025 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 610/1217] 10.222.0.16 () {54 vars in 921 bytes} [Thu Aug 18 21:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:56.235697 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2d059-89d0-4d7d-8ff5-ad97e39af5b6 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.236264 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2d059-89d0-4d7d-8ff5-ad97e39af5b6 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.236520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2d059-89d0-4d7d-8ff5-ad97e39af5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.267946 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-93d2d059-89d0-4d7d-8ff5-ad97e39af5b6 None None] MFA Rules not processed for user `ba197525d2af40528f7cbe7de9da9a23`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:56.269852 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-93d2d059-89d0-4d7d-8ff5-ad97e39af5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.280917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 608/1218] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Aug 18 21:13:56 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:56.295622 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79355150-b9e6-43c2-af71-3f4e50768ee4 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.317485 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79355150-b9e6-43c2-af71-3f4e50768ee4 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.322731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e437a3-56d6-4923-90cc-e1a79b056f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.323416 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e437a3-56d6-4923-90cc-e1a79b056f55 service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.323716 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e437a3-56d6-4923-90cc-e1a79b056f55 service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.323987 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e437a3-56d6-4923-90cc-e1a79b056f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.332378 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e437a3-56d6-4923-90cc-e1a79b056f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.333940 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e437a3-56d6-4923-90cc-e1a79b056f55 service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.344055 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 611/1219] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:06.254076 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=12 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:06.339614 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=15 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:10.191755 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2d059-89d0-4d7d-8ff5-ad97e39af5b6 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:10.201734 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2d059-89d0-4d7d-8ff5-ad97e39af5b6 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:10.205575 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbc7c9-913b-4cf0-91c3-e096ee310a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:10.206222 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbc7c9-913b-4cf0-91c3-e096ee310a15 service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:10.206499 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbc7c9-913b-4cf0-91c3-e096ee310a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:10.206812 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbc7c9-913b-4cf0-91c3-e096ee310a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:10.217685 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbc7c9-913b-4cf0-91c3-e096ee310a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:10.219405 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbc7c9-913b-4cf0-91c3-e096ee310a15 service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:10.231326 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 609/1220] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:10 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:20.225324 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=6 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:28.731211 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0731b1b-25d6-42a2-aff3-b932036fc896 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:28.731874 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0731b1b-25d6-42a2-aff3-b932036fc896 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:28.731874 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0731b1b-25d6-42a2-aff3-b932036fc896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:28.760084 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-c0731b1b-25d6-42a2-aff3-b932036fc896 None None] MFA Rules not processed for user `f6549a70b69645a6a8bd333c11c10c99`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:28.761233 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-c0731b1b-25d6-42a2-aff3-b932036fc896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:28.768576 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 612/1221] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:14:28 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:38.752173 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=3 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:57.767302 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1a23e-6c65-465c-aeed-a9f5304d5971 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:57.767811 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1a23e-6c65-465c-aeed-a9f5304d5971 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:57.767917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1a23e-6c65-465c-aeed-a9f5304d5971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:57.788294 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-25b1a23e-6c65-465c-aeed-a9f5304d5971 None None] MFA Rules not processed for user `f6549a70b69645a6a8bd333c11c10c99`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:57.789512 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-25b1a23e-6c65-465c-aeed-a9f5304d5971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:57.796472 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 610/1222] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:14:57 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:15:07.782712 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=3 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:15:12.819956 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba690d49-49f6-4343-82a1-f8592e0a8ee1 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:12.820488 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba690d49-49f6-4343-82a1-f8592e0a8ee1 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:12.820695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba690d49-49f6-4343-82a1-f8592e0a8ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:12.842395 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-ba690d49-49f6-4343-82a1-f8592e0a8ee1 None None] MFA Rules not processed for user `f6549a70b69645a6a8bd333c11c10c99`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:15:12.844262 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-ba690d49-49f6-4343-82a1-f8592e0a8ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:12.851933 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 613/1223] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:15:12 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:15:13.378778 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ec504-3483-4f2d-9e32-a9c174bc0885 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:13.379315 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ec504-3483-4f2d-9e32-a9c174bc0885 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:13.379420 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ec504-3483-4f2d-9e32-a9c174bc0885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:13.401331 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-a47ec504-3483-4f2d-9e32-a9c174bc0885 None None] MFA Rules not processed for user `b9326ebc83a2471a856f668ee77285c5`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:15:13.402548 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-a47ec504-3483-4f2d-9e32-a9c174bc0885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:13.409547 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 611/1224] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Aug 18 21:15:13 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:15:13.425180 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba690d49-49f6-4343-82a1-f8592e0a8ee1 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:13.435195 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba690d49-49f6-4343-82a1-f8592e0a8ee1 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:13.439893 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb91731-359d-49a9-b953-c262fe9d0aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:13.440520 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91731-359d-49a9-b953-c262fe9d0aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:13.440794 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91731-359d-49a9-b953-c262fe9d0aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:13.441072 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91731-359d-49a9-b953-c262fe9d0aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:13.457909 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb91731-359d-49a9-b953-c262fe9d0aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:13.459483 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb91731-359d-49a9-b953-c262fe9d0aa6 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:13.469618 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 614/1225] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:15:13 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:15:23.395067 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=3 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:15:23.465142 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=9 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:15.816564 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903d9b-18d3-4898-805c-600595d0530b None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:15.817076 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903d9b-18d3-4898-805c-600595d0530b None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:15.817167 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903d9b-18d3-4898-805c-600595d0530b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:15.841197 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-2f903d9b-18d3-4898-805c-600595d0530b None None] MFA Rules not processed for user `f6549a70b69645a6a8bd333c11c10c99`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:15.842443 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-2f903d9b-18d3-4898-805c-600595d0530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:15.849354 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 612/1226] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:16:15 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:25.830881 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=3 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:29.878484 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb91731-359d-49a9-b953-c262fe9d0aa6 service neutron] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:29.897491 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb91731-359d-49a9-b953-c262fe9d0aa6 service neutron] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:29.901230 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cef42-a076-4354-b24a-d91b06023881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:29.902330 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cef42-a076-4354-b24a-d91b06023881 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:29.902610 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cef42-a076-4354-b24a-d91b06023881 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:29.902882 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cef42-a076-4354-b24a-d91b06023881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:29.913494 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cef42-a076-4354-b24a-d91b06023881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:29.915013 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cef42-a076-4354-b24a-d91b06023881 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:29.927893 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 615/1227] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:29 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:32.181476 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75360b81-0566-4b5c-91ec-93dc91394db6 None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:32.182043 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75360b81-0566-4b5c-91ec-93dc91394db6 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:32.182043 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75360b81-0566-4b5c-91ec-93dc91394db6 None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:32.183458 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 613/1228] 10.222.0.16 () {54 vars in 921 bytes} [Thu Aug 18 21:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:16:32.188719 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41af6d-8e43-4453-a375-cd4312ca11f9 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:32.189187 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41af6d-8e43-4453-a375-cd4312ca11f9 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:32.189288 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41af6d-8e43-4453-a375-cd4312ca11f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:32.244401 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-ac41af6d-8e43-4453-a375-cd4312ca11f9 None None] MFA Rules not processed for user `ba197525d2af40528f7cbe7de9da9a23`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:32.245696 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-ac41af6d-8e43-4453-a375-cd4312ca11f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:32.264928 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 616/1229] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Aug 18 21:16:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:32.278268 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75360b81-0566-4b5c-91ec-93dc91394db6 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:32.295552 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75360b81-0566-4b5c-91ec-93dc91394db6 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:32.302744 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a614f-1e4a-48ea-8747-590694905157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:32.303519 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a614f-1e4a-48ea-8747-590694905157 service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:32.303884 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a614f-1e4a-48ea-8747-590694905157 service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:32.304221 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a614f-1e4a-48ea-8747-590694905157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:32.316068 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a614f-1e4a-48ea-8747-590694905157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:32.317780 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a614f-1e4a-48ea-8747-590694905157 service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:32.329012 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 614/1230] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:32 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:42.261578 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=27 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:42.324798 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=6 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:17:33.177897 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41af6d-8e43-4453-a375-cd4312ca11f9 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:17:33.200712 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41af6d-8e43-4453-a375-cd4312ca11f9 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:17:33.206407 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e030c4-35c4-4490-a89b-ddd317d57fbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42119f8b3cd5446ea7aca396ad1a0f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:17:33.207065 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e030c4-35c4-4490-a89b-ddd317d57fbd service placement] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:17:33.207323 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e030c4-35c4-4490-a89b-ddd317d57fbd service placement] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:17:33.207643 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e030c4-35c4-4490-a89b-ddd317d57fbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:17:33.218186 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e030c4-35c4-4490-a89b-ddd317d57fbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:17:33.219868 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e030c4-35c4-4490-a89b-ddd317d57fbd service placement] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:17:33.230048 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 617/1231] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:17:33 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:17:43.225880 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=10 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:18:37.283152 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a614f-1e4a-48ea-8747-590694905157 service nova] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:37.294676 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a614f-1e4a-48ea-8747-590694905157 service nova] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:37.299895 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ab8ab-3e74-46c6-937b-9b56749f684c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:37.300484 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ab8ab-3e74-46c6-937b-9b56749f684c service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:37.300794 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ab8ab-3e74-46c6-937b-9b56749f684c service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:37.301067 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ab8ab-3e74-46c6-937b-9b56749f684c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:37.308597 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ab8ab-3e74-46c6-937b-9b56749f684c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:37.310268 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ab8ab-3e74-46c6-937b-9b56749f684c service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:37.319390 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 615/1232] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:37 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:18:37.501151 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e030c4-35c4-4490-a89b-ddd317d57fbd service placement] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:37.511340 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e030c4-35c4-4490-a89b-ddd317d57fbd service placement] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:37.515037 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0b1c1-24b1-41b2-89f3-3b52de971cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:37.515811 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0b1c1-24b1-41b2-89f3-3b52de971cfc service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:37.516091 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0b1c1-24b1-41b2-89f3-3b52de971cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:37.516369 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0b1c1-24b1-41b2-89f3-3b52de971cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:37.526898 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0b1c1-24b1-41b2-89f3-3b52de971cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:37.528535 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0b1c1-24b1-41b2-89f3-3b52de971cfc service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:37.539542 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 618/1233] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:37 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:18:38.721261 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ab8ab-3e74-46c6-937b-9b56749f684c service nova] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:38.731749 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ab8ab-3e74-46c6-937b-9b56749f684c service nova] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:38.735016 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039837-db11-492b-8c39-5d542e85098a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:38.735642 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039837-db11-492b-8c39-5d542e85098a service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:38.735923 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039837-db11-492b-8c39-5d542e85098a service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:38.736197 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039837-db11-492b-8c39-5d542e85098a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:38.746430 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9039837-db11-492b-8c39-5d542e85098a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:38.747910 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9039837-db11-492b-8c39-5d542e85098a service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:38.757849 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 616/1234] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:18:42.230623 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e839a6-8b0c-458e-8185-9a90a7e2792a None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:42.231091 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e839a6-8b0c-458e-8185-9a90a7e2792a None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:42.231199 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e839a6-8b0c-458e-8185-9a90a7e2792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:42.250066 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-63e839a6-8b0c-458e-8185-9a90a7e2792a None None] MFA Rules not processed for user `f6549a70b69645a6a8bd333c11c10c99`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:18:42.251282 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-63e839a6-8b0c-458e-8185-9a90a7e2792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:18:42.258023 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 619/1235] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:18:42 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:18:43.005359 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039837-db11-492b-8c39-5d542e85098a service neutron] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:43.017006 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039837-db11-492b-8c39-5d542e85098a service neutron] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:43.021999 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1510d1b-42c1-470b-9346-09f4fea68fc0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42119f8b3cd5446ea7aca396ad1a0f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:43.022632 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510d1b-42c1-470b-9346-09f4fea68fc0 service placement] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:43.022914 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510d1b-42c1-470b-9346-09f4fea68fc0 service placement] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:43.023182 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510d1b-42c1-470b-9346-09f4fea68fc0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:43.031964 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1510d1b-42c1-470b-9346-09f4fea68fc0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:43.033624 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1510d1b-42c1-470b-9346-09f4fea68fc0 service placement] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:43.046796 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 617/1236] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:43 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:18:51.793352 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e839a6-8b0c-458e-8185-9a90a7e2792a None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:51.803411 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e839a6-8b0c-458e-8185-9a90a7e2792a None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:51.806942 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f3d8b-e4c9-40ba-90f2-92bcdb849cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:51.807576 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f3d8b-e4c9-40ba-90f2-92bcdb849cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:51.807857 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f3d8b-e4c9-40ba-90f2-92bcdb849cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:51.808128 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f3d8b-e4c9-40ba-90f2-92bcdb849cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:51.814988 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f3d8b-e4c9-40ba-90f2-92bcdb849cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:51.817157 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f3d8b-e4c9-40ba-90f2-92bcdb849cd6 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:51.825432 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 620/1237] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:51 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:18:53.040128 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=18 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:18:58.371335 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1510d1b-42c1-470b-9346-09f4fea68fc0 service placement] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:58.382285 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1510d1b-42c1-470b-9346-09f4fea68fc0 service placement] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:58.387220 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a374a27-3374-4c53-8bcd-30e89e03002a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:58.387828 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a374a27-3374-4c53-8bcd-30e89e03002a service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:58.388102 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a374a27-3374-4c53-8bcd-30e89e03002a service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:58.388376 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a374a27-3374-4c53-8bcd-30e89e03002a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:58.396472 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a374a27-3374-4c53-8bcd-30e89e03002a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:58.398039 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a374a27-3374-4c53-8bcd-30e89e03002a service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:58.406703 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 618/1238] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:58 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:19:01.821695 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=15 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:19:04.951675 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f3d8b-e4c9-40ba-90f2-92bcdb849cd6 service neutron] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:19:04.965145 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f3d8b-e4c9-40ba-90f2-92bcdb849cd6 service neutron] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:19:04.970914 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468201a-1f5d-4a03-acb7-1147fb72ba25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:19:04.971565 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468201a-1f5d-4a03-acb7-1147fb72ba25 service nova] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:04.972420 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468201a-1f5d-4a03-acb7-1147fb72ba25 service nova] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:04.973132 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468201a-1f5d-4a03-acb7-1147fb72ba25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:04.983817 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468201a-1f5d-4a03-acb7-1147fb72ba25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:19:04.985527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468201a-1f5d-4a03-acb7-1147fb72ba25 service nova] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:19:04.996527 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 621/1239] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:19:04 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:19:08.403318 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=6 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:19:14.007200 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25144ce1-3f31-4be4-822b-8c8e9194775f None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:14.007893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25144ce1-3f31-4be4-822b-8c8e9194775f None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:14.007893 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25144ce1-3f31-4be4-822b-8c8e9194775f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:14.027800 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-25144ce1-3f31-4be4-822b-8c8e9194775f None None] MFA Rules not processed for user `928951d9fc9444ca8d5ac6b38c4240cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:19:14.029017 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-25144ce1-3f31-4be4-822b-8c8e9194775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:19:14.036482 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 619/1240] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:19:14 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:19:14.307434 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468201a-1f5d-4a03-acb7-1147fb72ba25 service nova] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:19:14.317460 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468201a-1f5d-4a03-acb7-1147fb72ba25 service nova] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:19:14.321266 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f31581-c67d-4525-be88-25a2c3d31d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:19:14.321848 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f31581-c67d-4525-be88-25a2c3d31d51 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:14.322124 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f31581-c67d-4525-be88-25a2c3d31d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:14.322392 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f31581-c67d-4525-be88-25a2c3d31d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:14.329334 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f31581-c67d-4525-be88-25a2c3d31d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:19:14.331316 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f31581-c67d-4525-be88-25a2c3d31d51 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:19:14.338944 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 622/1241] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:19:14 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:19:24.022201 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=3 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:19:24.336266 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=12 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:19:31.818088 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25144ce1-3f31-4be4-822b-8c8e9194775f None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:19:31.830622 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25144ce1-3f31-4be4-822b-8c8e9194775f None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:19:31.836526 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe360df-5953-4bdd-b92d-1d538c90bb8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:19:31.837142 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe360df-5953-4bdd-b92d-1d538c90bb8e service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:31.837424 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe360df-5953-4bdd-b92d-1d538c90bb8e service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:31.837700 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe360df-5953-4bdd-b92d-1d538c90bb8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:31.847466 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe360df-5953-4bdd-b92d-1d538c90bb8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:19:31.849062 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe360df-5953-4bdd-b92d-1d538c90bb8e service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:19:31.859166 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 620/1242] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:19:31 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:19:40.857525 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f31581-c67d-4525-be88-25a2c3d31d51 service neutron] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:19:40.867543 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f31581-c67d-4525-be88-25a2c3d31d51 service neutron] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:19:40.871515 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0641eb-444f-41de-b418-04e18fce39ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:19:40.872194 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0641eb-444f-41de-b418-04e18fce39ea service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:40.872459 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0641eb-444f-41de-b418-04e18fce39ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:40.872724 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0641eb-444f-41de-b418-04e18fce39ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:40.882291 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0641eb-444f-41de-b418-04e18fce39ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:19:40.883756 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0641eb-444f-41de-b418-04e18fce39ea service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:19:40.894703 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 623/1243] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:19:40 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:19:41.854850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=6 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:19:50.889729 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=6 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:20:37.250649 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413895d-3be0-46f2-8ff3-208274197398 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:20:37.251180 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413895d-3be0-46f2-8ff3-208274197398 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:20:37.251300 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413895d-3be0-46f2-8ff3-208274197398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:20:37.272134 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-1413895d-3be0-46f2-8ff3-208274197398 None None] MFA Rules not processed for user `f6549a70b69645a6a8bd333c11c10c99`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:20:37.273337 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-1413895d-3be0-46f2-8ff3-208274197398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:20:37.280364 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 621/1244] 10.222.0.16 () {58 vars in 958 bytes} [Thu Aug 18 21:20:37 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:20:37.599776 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0641eb-444f-41de-b418-04e18fce39ea service neutron] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:20:37.608481 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0641eb-444f-41de-b418-04e18fce39ea service neutron] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:20:37.612397 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6aa8-9ea1-4898-b0be-b69b94f06072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:20:37.612991 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6aa8-9ea1-4898-b0be-b69b94f06072 service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:20:37.613269 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6aa8-9ea1-4898-b0be-b69b94f06072 service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:20:37.613544 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6aa8-9ea1-4898-b0be-b69b94f06072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:20:37.620827 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f6aa8-9ea1-4898-b0be-b69b94f06072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:20:37.622317 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f6aa8-9ea1-4898-b0be-b69b94f06072 service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:20:37.629894 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 624/1245] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:20:37 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:20:47.267252 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=3 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:20:47.626619 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=6 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:22:09.997086 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413895d-3be0-46f2-8ff3-208274197398 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:10.058962 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413895d-3be0-46f2-8ff3-208274197398 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:10.064538 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1aa585-6f9a-45b6-b3a2-f3eccfd874f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba197525d2af40528f7cbe7de9da9a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:10.065301 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1aa585-6f9a-45b6-b3a2-f3eccfd874f3 service nova] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:10.065631 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1aa585-6f9a-45b6-b3a2-f3eccfd874f3 service nova] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:10.065852 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1aa585-6f9a-45b6-b3a2-f3eccfd874f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:10.075825 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1aa585-6f9a-45b6-b3a2-f3eccfd874f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:10.077670 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1aa585-6f9a-45b6-b3a2-f3eccfd874f3 service nova] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:10.089611 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 622/1246] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:22:09 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:22:17.720000 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6aa8-9ea1-4898-b0be-b69b94f06072 service neutron] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:17.721576 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-810f6aa8-9ea1-4898-b0be-b69b94f06072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:22:17.761777 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6aa8-9ea1-4898-b0be-b69b94f06072 service neutron] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:17.766066 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3121f-6f67-4de9-b6c2-18d0177b07cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:17.766666 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3121f-6f67-4de9-b6c2-18d0177b07cc service neutron] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:17.766949 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3121f-6f67-4de9-b6c2-18d0177b07cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:17.767225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3121f-6f67-4de9-b6c2-18d0177b07cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:17.834771 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3121f-6f67-4de9-b6c2-18d0177b07cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:17.836168 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3121f-6f67-4de9-b6c2-18d0177b07cc service neutron] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:17.855395 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 625/1247] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:22:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:22:20.084460 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=20 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:22:21.060566 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5104c94-0e9c-4eca-9efc-4331e376cddb None None] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:21.060849 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5104c94-0e9c-4eca-9efc-4331e376cddb None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:21.061119 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5104c94-0e9c-4eca-9efc-4331e376cddb None None] PATH_INFO: `/` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:21.062501 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 623/1248] 10.222.0.16 () {54 vars in 921 bytes} [Thu Aug 18 21:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:22:21.092450 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0072ee1-5166-4f45-832b-9ef102077cb1 None None] REQUEST_METHOD: `POST` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:21.093669 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0072ee1-5166-4f45-832b-9ef102077cb1 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:21.093669 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0072ee1-5166-4f45-832b-9ef102077cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:21.162679 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.auth.core [None req-f0072ee1-5166-4f45-832b-9ef102077cb1 None None] MFA Rules not processed for user `42119f8b3cd5446ea7aca396ad1a0f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:22:21.163915 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-f0072ee1-5166-4f45-832b-9ef102077cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:22:21.172858 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 626/1249] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Aug 18 21:22:21 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:22:21.218633 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5104c94-0e9c-4eca-9efc-4331e376cddb None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:21.236673 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5104c94-0e9c-4eca-9efc-4331e376cddb None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:21.241831 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978cd25-ef51-44fe-bf11-9fe4ae36d6e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42119f8b3cd5446ea7aca396ad1a0f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:21.242477 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978cd25-ef51-44fe-bf11-9fe4ae36d6e1 service placement] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:21.242764 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978cd25-ef51-44fe-bf11-9fe4ae36d6e1 service placement] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:21.243041 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978cd25-ef51-44fe-bf11-9fe4ae36d6e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:21.253137 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978cd25-ef51-44fe-bf11-9fe4ae36d6e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:21.255513 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978cd25-ef51-44fe-bf11-9fe4ae36d6e1 service placement] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:21.266929 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 624/1250] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:22:21 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:22:24.264836 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0072ee1-5166-4f45-832b-9ef102077cb1 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:24.276147 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0072ee1-5166-4f45-832b-9ef102077cb1 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:24.281746 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:24.282396 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:24.282675 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:24.282944 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] PATH_INFO: `/v3/users/928951d9fc9444ca8d5ac6b38c4240cc` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:24.284101 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=928951d9fc9444ca8d5ac6b38c4240cc)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:24.285111 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: WARNING py.warnings [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:22:24.285111 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: warnings.warn(msg) Aug 18 21:22:24.285111 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: Aug 18 21:22:24.286316 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:24.356033 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928951d9fc9444ca8d5ac6b38c4240cc'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.374658 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:22:24.375912 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928951d9fc9444ca8d5ac6b38c4240cc'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.384078 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928951d9fc9444ca8d5ac6b38c4240cc'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.394743 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928951d9fc9444ca8d5ac6b38c4240cc'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.395534 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928951d9fc9444ca8d5ac6b38c4240cc'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.401583 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 627/1251] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Aug 18 21:22:24 2022] DELETE /identity/v3/users/928951d9fc9444ca8d5ac6b38c4240cc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:22:24.584624 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978cd25-ef51-44fe-bf11-9fe4ae36d6e1 service placement] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:24.596927 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978cd25-ef51-44fe-bf11-9fe4ae36d6e1 service placement] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:24.659527 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:24.660158 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:24.660450 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:24.660706 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] PATH_INFO: `/v3/projects/8eb23580723f4481be6477d5dd085fa2` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:24.661990 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb23580723f4481be6477d5dd085fa2)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:24.663412 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: WARNING py.warnings [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:22:24.663412 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: warnings.warn(msg) Aug 18 21:22:24.663412 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: Aug 18 21:22:24.664608 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:24.727520 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb23580723f4481be6477d5dd085fa2', 'request_id': 'req-772f9897-45c5-4bf7-8bb7-43004063da34'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.742969 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb23580723f4481be6477d5dd085fa2', 'request_id': 'req-772f9897-45c5-4bf7-8bb7-43004063da34'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.751533 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb23580723f4481be6477d5dd085fa2', 'request_id': 'req-772f9897-45c5-4bf7-8bb7-43004063da34'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.774210 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] The token cache is being invalidate because project 8eb23580723f4481be6477d5dd085fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:22:24.774560 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.775128 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.776666 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 625/1252] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Aug 18 21:22:24 2022] DELETE /identity/v3/projects/8eb23580723f4481be6477d5dd085fa2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:22:24.780731 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:24.782205 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:22:24.795229 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4453144-04bd-46d2-95b1-78831373c473 admin admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:24.850901 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:24.851557 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:24.851842 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:24.852118 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] PATH_INFO: `/v3/users/eb73431c513b4405aa65075d2536247b` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:24.853250 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb73431c513b4405aa65075d2536247b)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:24.855179 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:24.902717 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb73431c513b4405aa65075d2536247b'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.915748 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb73431c513b4405aa65075d2536247b'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.924345 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb73431c513b4405aa65075d2536247b'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.931990 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb73431c513b4405aa65075d2536247b'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.932641 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb73431c513b4405aa65075d2536247b'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:24.938872 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 628/1253] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Aug 18 21:22:24 2022] DELETE /identity/v3/users/eb73431c513b4405aa65075d2536247b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:22:25.110104 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:25.111697 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:22:25.129395 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f9897-45c5-4bf7-8bb7-43004063da34 admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:25.187603 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:25.188251 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:25.188531 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:25.188834 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] PATH_INFO: `/v3/projects/96c6fafd1a1d42a7a06b5fad0bcaf8b2` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:25.190277 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c6fafd1a1d42a7a06b5fad0bcaf8b2)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:25.192321 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:25.201319 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:22:25.247085 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c6fafd1a1d42a7a06b5fad0bcaf8b2', 'request_id': 'req-50ec4009-37c5-4b29-bbe2-cadfe14c3440'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:25.253883 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c6fafd1a1d42a7a06b5fad0bcaf8b2', 'request_id': 'req-50ec4009-37c5-4b29-bbe2-cadfe14c3440'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:25.262412 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c6fafd1a1d42a7a06b5fad0bcaf8b2', 'request_id': 'req-50ec4009-37c5-4b29-bbe2-cadfe14c3440'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:25.275129 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] The token cache is being invalidate because project 96c6fafd1a1d42a7a06b5fad0bcaf8b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:22:25.275452 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:25.276119 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:25.286850 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 626/1254] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Aug 18 21:22:25 2022] DELETE /identity/v3/projects/96c6fafd1a1d42a7a06b5fad0bcaf8b2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:22:33.498500 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:33.499999 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:22:33.564098 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:22:33.571007 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4587e10-91a0-4ee6-b648-b14902a98e14 admin admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:33.631785 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ae355-e9d0-4c4e-8c8c-d61d6a065040 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42119f8b3cd5446ea7aca396ad1a0f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:33.632324 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae355-e9d0-4c4e-8c8c-d61d6a065040 service placement] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:33.632633 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae355-e9d0-4c4e-8c8c-d61d6a065040 service placement] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:33.632908 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae355-e9d0-4c4e-8c8c-d61d6a065040 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:33.634642 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-8e9ae355-e9d0-4c4e-8c8c-d61d6a065040 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:22:33.646054 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ae355-e9d0-4c4e-8c8c-d61d6a065040 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:33.647663 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ae355-e9d0-4c4e-8c8c-d61d6a065040 service placement] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:33.657657 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 629/1255] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:22:33 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:22:35.271917 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:22:43.653156 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=31 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:23:12.650485 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:23:12.652109 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:23:12.721268 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec4009-37c5-4b29-bbe2-cadfe14c3440 admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:23:12.724889 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e47bb-330f-4a14-8d28-2b17f4d82f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9326ebc83a2471a856f668ee77285c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:23:12.725589 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e47bb-330f-4a14-8d28-2b17f4d82f23 service neutron] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:23:12.725992 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e47bb-330f-4a14-8d28-2b17f4d82f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:23:12.726265 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e47bb-330f-4a14-8d28-2b17f4d82f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:23:12.728114 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-249e47bb-330f-4a14-8d28-2b17f4d82f23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:23:12.788830 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e47bb-330f-4a14-8d28-2b17f4d82f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:23:12.790262 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e47bb-330f-4a14-8d28-2b17f4d82f23 service neutron] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:23:12.800030 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 627/1256] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:23:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:23:19.011403 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7bdf6-0b3f-4da5-872c-6f398ef50427 None None] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:23:19.011889 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7bdf6-0b3f-4da5-872c-6f398ef50427 None None] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:23:19.011975 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7bdf6-0b3f-4da5-872c-6f398ef50427 None None] PATH_INFO: `/` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:23:19.014214 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 630/1257] 10.222.0.16 () {54 vars in 921 bytes} [Thu Aug 18 21:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:23:19.027828 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f8e80-5035-4649-a121-0c67689d66d2 None None] REQUEST_METHOD: `POST` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:23:19.028340 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f8e80-5035-4649-a121-0c67689d66d2 None None] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:23:19.028505 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f8e80-5035-4649-a121-0c67689d66d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:23:19.047994 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.auth.core [None req-cd0f8e80-5035-4649-a121-0c67689d66d2 None None] MFA Rules not processed for user `42119f8b3cd5446ea7aca396ad1a0f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:23:19.049213 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-cd0f8e80-5035-4649-a121-0c67689d66d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:23:19.058255 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 628/1258] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Aug 18 21:23:19 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:23:19.080629 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7bdf6-0b3f-4da5-872c-6f398ef50427 None None] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:23:19.082557 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-13b7bdf6-0b3f-4da5-872c-6f398ef50427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:23:19.096649 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f8e80-5035-4649-a121-0c67689d66d2 None None] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:23:19.098395 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-cd0f8e80-5035-4649-a121-0c67689d66d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:23:19.100749 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7bdf6-0b3f-4da5-872c-6f398ef50427 None None] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:23:19.110225 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058cd82-7923-48a8-a853-a6f7aa154470 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42119f8b3cd5446ea7aca396ad1a0f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:23:19.110845 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058cd82-7923-48a8-a853-a6f7aa154470 service placement] REQUEST_METHOD: `GET` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:23:19.111122 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058cd82-7923-48a8-a853-a6f7aa154470 service placement] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:23:19.111428 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058cd82-7923-48a8-a853-a6f7aa154470 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:23:19.112771 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f8e80-5035-4649-a121-0c67689d66d2 None None] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:23:19.117344 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:23:19.118006 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:23:19.118287 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:23:19.118561 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] PATH_INFO: `/v3/users/f6549a70b69645a6a8bd333c11c10c99` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:23:19.125823 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058cd82-7923-48a8-a853-a6f7aa154470 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:23:19.127909 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058cd82-7923-48a8-a853-a6f7aa154470 service placement] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:23:19.133532 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6549a70b69645a6a8bd333c11c10c99)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:23:19.135537 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:23:19.137698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 631/1259] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:23:19 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:23:19.182345 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6549a70b69645a6a8bd333c11c10c99'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.195242 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6549a70b69645a6a8bd333c11c10c99'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.195970 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6549a70b69645a6a8bd333c11c10c99'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.203759 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6549a70b69645a6a8bd333c11c10c99'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.206438 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:23:19.212904 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6549a70b69645a6a8bd333c11c10c99'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.221833 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 629/1260] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Aug 18 21:23:19 2022] DELETE /identity/v3/users/f6549a70b69645a6a8bd333c11c10c99 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:23:19.400031 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058cd82-7923-48a8-a853-a6f7aa154470 service placement] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:23:19.412164 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058cd82-7923-48a8-a853-a6f7aa154470 service placement] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:23:19.467810 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:23:19.468609 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:23:19.468885 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:23:19.469155 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] PATH_INFO: `/v3/projects/a72ada771de84464beebe8bbb23bf990` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:23:19.480005 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72ada771de84464beebe8bbb23bf990)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:23:19.481948 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:23:19.525848 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72ada771de84464beebe8bbb23bf990', 'request_id': 'req-4a2a286c-3361-492c-94bb-5393fa9a79a2'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.534576 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72ada771de84464beebe8bbb23bf990', 'request_id': 'req-4a2a286c-3361-492c-94bb-5393fa9a79a2'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.541233 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72ada771de84464beebe8bbb23bf990', 'request_id': 'req-4a2a286c-3361-492c-94bb-5393fa9a79a2'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.551982 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] The token cache is being invalidate because project a72ada771de84464beebe8bbb23bf990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:23:19.552268 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.552912 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.554368 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 632/1261] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Aug 18 21:23:19 2022] DELETE /identity/v3/projects/a72ada771de84464beebe8bbb23bf990 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:23:19.558458 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:23:19.559983 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:23:19.573131 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58a8f8-bdd3-44f9-8203-b38618abe7aa admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:23:19.631020 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:23:19.631694 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:23:19.631982 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:23:19.632261 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] PATH_INFO: `/v3/users/4a200626f46c40e6b23cab45af448b88` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:23:19.645957 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a200626f46c40e6b23cab45af448b88)` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:23:19.647972 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:23:19.695314 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a200626f46c40e6b23cab45af448b88'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.707496 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a200626f46c40e6b23cab45af448b88'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.708199 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a200626f46c40e6b23cab45af448b88'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.715129 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a200626f46c40e6b23cab45af448b88'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.723055 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.notifications [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a200626f46c40e6b23cab45af448b88'} {{(pid=88582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:19.728970 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 630/1262] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Aug 18 21:23:19 2022] DELETE /identity/v3/users/4a200626f46c40e6b23cab45af448b88 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:23:19.899195 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] Authenticating user token {{(pid=88581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:23:19.900687 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.fernet_utils [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:23:19.916169 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a286c-3361-492c-94bb-5393fa9a79a2 admin admin] Validating token access rules against request {{(pid=88581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:23:19.972803 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082633d-e052-4e69-a848-69d515e7cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71471eb8a3e6483ebb3f0a3b9d99aedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fde81811a6d48dea0f606eb2c250dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:23:19.973477 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082633d-e052-4e69-a848-69d515e7cdba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:23:19.973698 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082633d-e052-4e69-a848-69d515e7cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:23:19.973990 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082633d-e052-4e69-a848-69d515e7cdba admin admin] PATH_INFO: `/v3/projects/4509f429ec824f6a987f4efc5c9b8506` {{(pid=88581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:23:19.985136 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082633d-e052-4e69-a848-69d515e7cdba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4509f429ec824f6a987f4efc5c9b8506)` {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:23:19.987243 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082633d-e052-4e69-a848-69d515e7cdba admin admin] RBAC: Authorization granted {{(pid=88581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:23:19.988677 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:23:20.035528 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-3082633d-e052-4e69-a848-69d515e7cdba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4509f429ec824f6a987f4efc5c9b8506', 'request_id': 'req-3082633d-e052-4e69-a848-69d515e7cdba'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:20.042708 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-3082633d-e052-4e69-a848-69d515e7cdba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4509f429ec824f6a987f4efc5c9b8506', 'request_id': 'req-3082633d-e052-4e69-a848-69d515e7cdba'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:20.051531 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-3082633d-e052-4e69-a848-69d515e7cdba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4509f429ec824f6a987f4efc5c9b8506', 'request_id': 'req-3082633d-e052-4e69-a848-69d515e7cdba'} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:20.062069 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-3082633d-e052-4e69-a848-69d515e7cdba admin admin] The token cache is being invalidate because project 4509f429ec824f6a987f4efc5c9b8506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:23:20.062355 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-3082633d-e052-4e69-a848-69d515e7cdba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:20.062986 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG keystone.notifications [None req-3082633d-e052-4e69-a848-69d515e7cdba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:23:20.064456 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: [pid: 88581|app: 0|req: 633/1263] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Aug 18 21:23:19 2022] DELETE /identity/v3/projects/4509f429ec824f6a987f4efc5c9b8506 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:23:29.725571 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:DELETE=11,keystone:SELECT=60,keystone:INSERT=1 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:23:30.058551 dv-osbrick-849018-5-ceph devstack@keystone.service[88581]: DEBUG dbcounter [-] [88581] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:27:41.193725 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] Authenticating user token {{(pid=88582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:27:41.195124 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:27:41.272249 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e834efc-e47d-4f32-9763-b1ff927dbceb admin admin] Validating token access rules against request {{(pid=88582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:27:41.329998 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576809ac-0194-41cf-9c5b-2e3ddcfa4d94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42119f8b3cd5446ea7aca396ad1a0f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55812d15e0dc4e75bb9a31abfa3387bf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:27:41.330608 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576809ac-0194-41cf-9c5b-2e3ddcfa4d94 service placement] REQUEST_METHOD: `GET` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:27:41.330892 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576809ac-0194-41cf-9c5b-2e3ddcfa4d94 service placement] SCRIPT_NAME: `/identity` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:27:41.331168 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576809ac-0194-41cf-9c5b-2e3ddcfa4d94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:27:41.332925 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.fernet_utils [None req-576809ac-0194-41cf-9c5b-2e3ddcfa4d94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:27:41.344263 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576809ac-0194-41cf-9c5b-2e3ddcfa4d94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:27:41.345860 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576809ac-0194-41cf-9c5b-2e3ddcfa4d94 service placement] RBAC: Authorization granted {{(pid=88582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:27:41.355364 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: [pid: 88582|app: 0|req: 631/1264] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Aug 18 21:27:41 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:27:51.351449 dv-osbrick-849018-5-ceph devstack@keystone.service[88582]: DEBUG dbcounter [-] [88582] Writing DB stats keystone:SELECT=62 {{(pid=88582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}